Apr 29 19:03:46 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 19:03:46 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 19:03:46 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 19:03:47 devstack cinder-volume[75836]: INFO dbcounter [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Registered counter for database cinder Apr 29 19:03:47 devstack cinder-volume[75836]: DEBUG oslo_db.sqlalchemy.engines [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:03:47 devstack cinder-volume[75836]: DEBUG dbcounter [-] [75836] Writer thread running {{(pid=75836) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 19:03:47 devstack cinder-volume[75836]: INFO cinder.rpc [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 19:03:47 devstack cinder-volume[75836]: INFO cinder.rpc [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 19:03:47 devstack cinder-volume[75836]: DEBUG oslo_db.sqlalchemy.engines [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:03:47 devstack cinder-volume[75836]: INFO cinder.volume.manager [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Determined volume DB was empty at startup. Apr 29 19:03:47 devstack cinder-volume[75836]: DEBUG cinder.volume.manager [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75836) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 29 19:03:47 devstack cinder-volume[75836]: INFO cinder.volume.manager [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 19:03:47 devstack cinder-volume[75836]: WARNING stevedore.named [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 19:03:47 devstack cinder-volume[75836]: WARNING castellan.key_manager [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 19:03:47 devstack cinder-volume[75836]: WARNING cinder.keymgr.conf_key_mgr [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 19:03:47 devstack cinder-volume[75836]: DEBUG cinder.volume.drivers.lvm [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75836) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 19:03:47 devstack cinder-volume[75836]: DEBUG oslo_concurrency.processutils [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75836) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_concurrency.processutils [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] CMD "cinder-rtstool verify" returned: 0 in 0.489s {{(pid=75836) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_db.sqlalchemy.engines [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:03:48 devstack cinder-volume[75836]: INFO cinder.rpc [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 19:03:48 devstack cinder-volume[75836]: INFO cinder.rpc [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 19:03:48 devstack cinder-volume[75836]: WARNING stevedore.named [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 19:03:48 devstack cinder-volume[75836]: WARNING castellan.key_manager [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 19:03:48 devstack cinder-volume[75836]: INFO cinder.volume.manager [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_db.sqlalchemy.engines [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75836) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:03:48 devstack cinder-volume[75836]: INFO oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Starting 1 workers Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Started child 76016 {{(pid=75836) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Full set of CONF: {{(pid=75836) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] ******************************************************************************** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Configuration options gathered from: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] ================================================================================ {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] allow_availability_zone_fallback = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] allow_compression_on_image_upload = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] allowed_direct_url_schemes = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] api_rate_limit = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] auth_strategy = keystone {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] az_cache_duration = 3600 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_availability_zone = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_host = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[76016]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_stats_polling_interval = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backup_api_class = cinder.backup.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backup_name_template = backup-%s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backup_use_same_host = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backup_use_temp_snapshot = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] chap_password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] chap_username = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_internal_tenant_project_id = 2d5a8fc43df14d81aa383fc89084e658 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_internal_tenant_user_id = 3683337fce6e413a996eaeb0a07f278f {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cloned_volume_same_az = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cluster = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] compression_format = gzip {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] compute_api_class = cinder.compute.nova.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] config_dir = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] config_source = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] control_exchange = openstack {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] debug = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] default_availability_zone = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] default_group_type = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] default_volume_type = lvmdriver-1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] disk_geometry = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] driver_client_cert = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] driver_client_cert_key = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack sudo[76042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] driver_data_namespace = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] driver_ssl_cert_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] driver_ssl_cert_verify = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] driver_use_ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] enable_force_upload = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] enable_new_services = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] enable_unsupported_driver = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack sudo[76042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] enforce_multipath_for_image_xfer = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] filter_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_api_insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_api_ssl_compression = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_ca_certificates_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_catalog_info = image:glance:publicURL {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 19:03:48 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_num_retries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance_request_timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] goodness_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] graceful_shutdown_timeout = 5 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] group_api_class = cinder.group.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] host = devstack {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_compress_on_upload = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_conversion_address_space_limit = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_conversion_cpu_limit = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_conversion_disable = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_upload_use_cinder_backend = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_upload_use_internal_tenant = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_volume_cache_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_volume_cache_max_count = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] image_volume_cache_max_size_gb = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] init_host_max_objects_retrieval = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] instance_format = [instance: %(uuid)s] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] iscsi_target_flags = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] iscsi_write_cache = on {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] iser_helper = tgtadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] iser_ip_address = 192.168.122.89 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] iser_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_color = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_config_append = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_dir = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_options = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_rotate_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_rotate_interval_type = days {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] log_rotation_type = none {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] max_age = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] max_logfile_count = 30 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] max_logfile_size_mb = 200 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] max_over_subscription_ratio = 20.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:48 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] message_reap_interval = 86400 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] message_ttl = 2592000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] migration_create_volume_timeout_secs = 300 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] monkey_patch = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] monkey_patch_modules = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] my_ip = 192.168.122.89 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] no_snapshot_gb_quota = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] num_iser_scan_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] num_shell_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] num_volume_device_scan_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] nvmeof_conn_info_version = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] nvmet_ns_id = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] nvmet_port_id = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] osapi_max_limit = 1000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] osapi_volume_ext_list = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] osapi_volume_listen_port = 8776 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] osapi_volume_use_ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] osapi_volume_workers = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] per_volume_size_limit = -1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] periodic_fuzzy_delay = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] periodic_interval = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] public_endpoint = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] publish_errors = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] quota_backup_gigabytes = 1000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] quota_backups = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] quota_gigabytes = 1000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] quota_groups = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] quota_snapshots = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] quota_volumes = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] rate_limit_burst = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] rate_limit_except_level = CRITICAL {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] rate_limit_interval = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] reinit_driver_count = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] replication_device = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] report_discard_supported = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:48 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] report_interval = 120 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] reservation_clean_interval = 86400 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] reservation_expire = 86400 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] reserved_image_namespaces = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] reserved_percentage = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] rpc_response_timeout = 120 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] run_external_periodic_tasks = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] scst_target_driver = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] scst_target_iqn_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_down_time = 720 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] shell_completion = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] snapshot_name_template = snapshot-%s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] snapshot_same_host = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] state_path = /opt/stack/data/cinder {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] storage_availability_zone = nova {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] storage_protocol = iSCSI {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] syslog_log_facility = LOG_USER {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] target_helper = lioadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] target_ip_address = 192.168.122.89 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] target_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] target_protocol = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] target_secondary_ip_addresses = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] trace_flags = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] transport_url = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] until_refresh = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] use_chap_auth = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] use_default_quota_class = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] use_journal = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] use_json = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] use_multipath_for_image_xfer = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] use_stderr = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] use_syslog = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] verify_glance_signatures = enabled {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_api_class = cinder.volume.api.API {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_backend_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_clear = zero {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_clear_ionice = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_clear_size = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_copy_bps_limit = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_dd_blocksize = 1M {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_name_template = volume-%s {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_service_inithost_offload = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volume_usage_audit_period = month {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] zoning_mode = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_concurrency.disable_process_locking = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.admin_password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.admin_token = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.admin_user = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.auth_port = 35357 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.auth_protocol = https {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.auth_section = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.auth_type = password {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.auth_uri = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.auth_version = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.cache = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.identity_uri = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.include_service_catalog = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.interface = public {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_password = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcache_username = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.region_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.service_type = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.backend = dogpile.cache.null {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.backend_argument = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.backend_expiration_time = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.config_prefix = cache.oslo {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.debug_cache_backend = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.enable_retry_client = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.enable_socket_keepalive = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.enforce_fips_mode = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.expiration_time = 600 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.hashclient_retry_attempts = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.memcache_dead_retry = 300 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.memcache_pool_maxsize = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.memcache_sasl_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.proxies = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.redis_db = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.redis_server = localhost:6379 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.retry_attempts = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.retry_delay = 0.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.socket_keepalive_count = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.socket_keepalive_idle = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.socket_keepalive_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.socket_timeout = 1.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.tls_allowed_ciphers = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.tls_cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.tls_certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.tls_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.tls_keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cache.username = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] coordination.backend_url = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.asyncio_connection = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.asyncio_slave_connection = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.backend = sqlalchemy {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.connection = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.connection_debug = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.connection_parameters = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.connection_recycle_time = 3600 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.connection_trace = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.db_inc_retry_interval = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.db_max_retries = 20 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.db_max_retry_interval = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.db_retry_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.max_overflow = 50 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.max_pool_size = 5 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.max_retries = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.mysql_wsrep_sync_wait = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.pool_timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.retry_interval = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.slave_connection = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.sqlite_synchronous = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.synchronous_reader = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] database.use_db_reconnect = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.connection_string = messaging:// {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.es_doc_type = notification {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.es_scroll_size = 10000 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.es_scroll_time = 2m {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.filter_error_trace = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.hmac_keys = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.sentinel_service_name = mymaster {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.socket_timeout = 0.1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.trace_requests = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler.trace_sqlalchemy = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler_jaeger.process_tags = {} {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler_jaeger.service_name_prefix = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] profiler_otlp.service_name_prefix = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.enforce_new_defaults = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: WARNING oslo_config.cfg [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.enforce_scope = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.policy_default_rule = default {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.policy_file = policy.yaml {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] privsep_osbrick.group = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] privsep_osbrick.helper_command = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] privsep_osbrick.user = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_sys_admin.group = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_sys_admin.helper_command = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] cinder_sys_admin.user = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.auth_section = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.auth_type = password {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.collect_timing = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.send_service_user_token = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] service_user.timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.auth_section = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.auth_type = password {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.collect_timing = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.region_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] glance.timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.backend_availability_zone = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.chap_password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.chap_username = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.disk_geometry = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.driver_client_cert = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.driver_client_cert_key = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.driver_data_namespace = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.driver_use_ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.extra_capabilities = {} {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.filter_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.goodness_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.iscsi_target_flags = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.iscsi_write_cache = on {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.iser_helper = tgtadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.iser_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.lvm_share_target = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.lvm_type = auto {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.num_shell_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.replication_device = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.report_discard_supported = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.reserved_percentage = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.target_helper = tgtadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.target_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.target_protocol = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.trace_flags = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.unique_fqdn_network = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.use_chap_auth = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_backend_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_clear = zero {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_clear_ionice = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_clear_size = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_reports.file_event_handler = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_reports.log_dir = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.backend_host = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.chap_password = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.chap_username = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.disk_geometry = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.driver_client_cert = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.extra_capabilities = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.filter_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.goodness_function = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.iser_helper = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.iser_ip_address = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.iser_port = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.lvm_share_target = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.lvm_type = auto {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.num_shell_tries = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.replication_device = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.report_discard_supported = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.reserved_percentage = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.scst_target_driver = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.storage_protocol = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.target_helper = lioadm {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.target_ip_address = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.target_port = 3260 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.trace_flags = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.use_chap_auth = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_clear = zero {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_clear_size = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] lvmdriver-1.volumes_dir = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_notifications.driver = [] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_notifications.retry = -1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] key_manager.fixed_key = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.barbican_api_version = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.barbican_endpoint = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.barbican_endpoint_type = public {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.barbican_region_name = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.collect_timing = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.number_of_retries = 60 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.retry_delay = 1 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.send_service_user_token = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.verify_ssl = True {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican.verify_ssl_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.auth_section = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.auth_type = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.cafile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.certfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.collect_timing = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.insecure = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.keyfile = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.split_loggers = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] barbican_service_user.timeout = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.approle_role_id = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.approle_secret_id = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.kv_mountpoint = secret {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.kv_path = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.kv_version = 2 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.namespace = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.root_token_id = **** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.ssl_ca_crt_file = None {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.timeout = 60.0 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.use_ssl = False {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:03:48 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] ******************************************************************************** {{(pid=75836) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 19:03:49 devstack sudo[76042]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:49 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.736s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:49 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:49 devstack sudo[76272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:03:49 devstack sudo[76272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:49 devstack sudo[76272]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:49 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.602s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:49 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:03:49 devstack cinder-volume[76016]: INFO cinder.brick.local_dev.lvm [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 19:03:49 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:49 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:49 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:49 devstack sudo[76460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 19:03:49 devstack sudo[76460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:50 devstack sudo[76460]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:50 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:50 devstack cinder-volume[76016]: DEBUG cinder.brick.local_dev.lvm [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76016) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 19:03:50 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:50 devstack sudo[76576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:03:50 devstack sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:51 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.216s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:51 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:51 devstack sudo[76576]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:51 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:51 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:51 devstack sudo[76787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:03:51 devstack sudo[76787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:52 devstack sudo[76787]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:52 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.969s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:52 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:52 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:52 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:52 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 19:03:52 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:53 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:53 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.636s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:53 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:53 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 19:03:53 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:53 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:53 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:53 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:53 devstack sudo[76800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 19:03:53 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:54 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:54 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:54 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:54 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:03:54 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:55 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:55 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:55 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:55 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:03:55 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:56 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:56 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.763s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:56 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:56 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:56 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:56 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:03:56 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:56 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:56 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.829s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:56 devstack cinder-volume[76016]: INFO cinder.volume.drivers.lvm [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 19:03:56 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:56 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:56 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:56 devstack sudo[76825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:03:56 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:57 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:57 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:57 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 19:03:57 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:57 devstack sudo[76939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 19:03:57 devstack sudo[76939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:58 devstack sudo[76939]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:58 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:58 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:58 devstack cinder-volume[75836]: DEBUG dbcounter [-] [75836] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75836) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:03:58 devstack sudo[76972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:03:58 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:58 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:58 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:58 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:58 devstack sudo[77088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:03:58 devstack sudo[77088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:59 devstack sudo[77088]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:59 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.588s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:59 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:03:59 devstack sudo[77091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:03:59 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:03:59 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root Apr 29 19:03:59 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:03:59 devstack cinder-volume[76016]: INFO cinder.volume.driver [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Driver hasn't implemented _init_vendor_properties() Apr 29 19:03:59 devstack cinder-volume[76016]: DEBUG cinder.volume.driver [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76016) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 19:04:00 devstack cinder-volume[76016]: DEBUG oslo_db.sqlalchemy.engines [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:04:00 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writer thread running {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 19:04:00 devstack cinder-volume[76016]: DEBUG cinder.db.sqlalchemy.api [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Building query based on filter {{(pid=76016) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 19:04:00 devstack cinder-volume[76016]: DEBUG cinder.image.image_utils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76016) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 19:04:00 devstack cinder-volume[76016]: INFO cinder.keymgr.migration [None req-09178c74-61b1-415d-9212-b69061ac3a5e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 19:04:00 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 19:04:00 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:00 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 19:04:00 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:00 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:00 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:00 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:00 devstack sudo[77099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:04:00 devstack sudo[77099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:01 devstack sudo[77099]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:01 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:01 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:01 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:04:01 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:02 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:02 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:02 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:02 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:04:02 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:02 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:02 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:02 devstack cinder-volume[76016]: DEBUG cinder.manager [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Notifying Schedulers of capabilities ... {{(pid=76016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:04:02 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Driver initialization completed successfully. Apr 29 19:04:02 devstack cinder-volume[76016]: INFO cinder.manager [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Initiating service 2 cleanup Apr 29 19:04:02 devstack cinder-volume[76016]: INFO cinder.manager [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Service 2 cleanup completed. Apr 29 19:04:02 devstack cinder-volume[76016]: DEBUG cinder.service [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Creating RPC server for service cinder-volume {{(pid=76016) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 19:04:02 devstack cinder-volume[76016]: DEBUG cinder.service [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76016) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 19:04:02 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 19:04:02 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 19:04:02 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:02 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 19:04:02 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:03 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:03 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:03 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:03 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:04:03 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:04 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:04 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:04 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:04 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:04:04 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:04 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:04 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:04 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:04:04 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:04:04 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:04:05 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Apr 29 19:04:05 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:04:05 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-18d8d335-f9ec-4334-b494-d17636a6f48d None None] Driver post RPC initialization completed successfully. Apr 29 19:04:12 devstack cinder-volume[76016]: DEBUG oslo_service.periodic_task [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running periodic task VolumeManager._thread_info {{(pid=76016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:04:12 devstack cinder-volume[76016]: DEBUG cinder.volume.manager [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] thread count: 6 {{(pid=76016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:04:12 devstack cinder-volume[76016]: DEBUG cinder.volume.manager [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] thread info: [<_MainThread(MainThread, started 137549571051648)>, , , , , ] {{(pid=76016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:04:12 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:SELECT=4 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:04:15 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:05:12 devstack cinder-volume[76016]: DEBUG oslo_service.periodic_task [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:05:12 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 19:05:12 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:12 devstack sudo[79374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 19:05:12 devstack sudo[79374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:13 devstack sudo[79374]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:13 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:13 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:13 devstack sudo[79377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:05:13 devstack sudo[79377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:13 devstack sudo[79377]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:13 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:13 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:13 devstack sudo[79381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:05:13 devstack sudo[79381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:14 devstack sudo[79381]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:05:14 devstack sudo[79384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:05:14 devstack sudo[79384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:05:15 devstack sudo[79384]: pam_unix(sudo:session): session closed for user root Apr 29 19:05:15 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:05:15 devstack cinder-volume[76016]: DEBUG cinder.manager [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Notifying Schedulers of capabilities ... {{(pid=76016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:05:15 devstack cinder-volume[76016]: DEBUG oslo_service.periodic_task [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running periodic task VolumeManager._thread_info {{(pid=76016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:05:15 devstack cinder-volume[76016]: DEBUG cinder.volume.manager [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] thread count: 6 {{(pid=76016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:05:15 devstack cinder-volume[76016]: DEBUG cinder.volume.manager [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] thread info: [<_MainThread(MainThread, started 137549571051648)>, , , , , ] {{(pid=76016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:06:12 devstack cinder-volume[76016]: DEBUG oslo_service.periodic_task [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:06:12 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Updating volume stats {{(pid=76016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 19:06:12 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:12 devstack sudo[82263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 19:06:12 devstack sudo[82263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:13 devstack sudo[82263]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:13 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:13 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:13 devstack sudo[82266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:06:13 devstack sudo[82266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:13 devstack sudo[82266]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:13 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:13 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:13 devstack sudo[82269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 19:06:13 devstack sudo[82269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:14 devstack sudo[82269]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.597s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:14 devstack sudo[82272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 19:06:14 devstack sudo[82272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:14 devstack sudo[82272]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:14 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:14 devstack cinder-volume[76016]: DEBUG cinder.manager [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Notifying Schedulers of capabilities ... {{(pid=76016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:06:14 devstack cinder-volume[76016]: DEBUG oslo_service.periodic_task [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] Running periodic task VolumeManager._thread_info {{(pid=76016) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:06:14 devstack cinder-volume[76016]: DEBUG cinder.volume.manager [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] thread count: 6 {{(pid=76016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:06:14 devstack cinder-volume[76016]: DEBUG cinder.volume.manager [None req-aae7b870-50c0-404b-b687-0e2b9bbfd97e None None] thread info: [<_MainThread(MainThread, started 137549571051648)>, , , , , ] {{(pid=76016) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:06:15 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:SELECT=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:06:15 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:UPDATE=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:06:52 devstack cinder-volume[75836]: INFO oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Caught SIGTERM, stopping children Apr 29 19:06:52 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Acquiring lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 19:06:52 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Acquired lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 19:06:52 devstack cinder-volume[75836]: DEBUG oslo_concurrency.lockutils [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Releasing lock "singleton_lock" {{(pid=75836) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 19:06:52 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Stop services. {{(pid=75836) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 19:06:52 devstack cinder-volume[75836]: DEBUG oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Killing children. {{(pid=75836) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 19:06:52 devstack cinder-volume[75836]: INFO oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Waiting on 1 children to exit Apr 29 19:06:52 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Acquiring lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 19:06:52 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Acquired lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 19:06:52 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Releasing lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 19:06:52 devstack cinder-volume[76016]: WARNING amqp [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 19:06:52 devstack cinder-volume[76016]: WARNING amqp [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 19:06:52 devstack cinder-volume[75836]: INFO oslo_service.backend._eventlet.service [None req-75c74265-16b7-4b5b-953c-31df63d4a988 None None] Child 76016 exited with status 0 Apr 29 19:06:55 devstack cinder-volume[83633]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 19:06:55 devstack cinder-volume[83633]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 19:06:55 devstack cinder-volume[83633]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 19:06:56 devstack cinder-volume[83633]: INFO dbcounter [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Registered counter for database cinder Apr 29 19:06:56 devstack cinder-volume[83633]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83633) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:06:56 devstack cinder-volume[83633]: DEBUG dbcounter [-] [83633] Writer thread running {{(pid=83633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 19:06:56 devstack cinder-volume[83633]: INFO cinder.rpc [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 19:06:56 devstack cinder-volume[83633]: INFO cinder.rpc [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 19:06:56 devstack cinder-volume[83633]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83633) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:06:57 devstack cinder-volume[83633]: INFO cinder.volume.manager [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Determined volume DB was empty at startup. Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG cinder.volume.manager [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83633) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 29 19:06:57 devstack cinder-volume[83633]: INFO cinder.volume.manager [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 19:06:57 devstack cinder-volume[83633]: WARNING stevedore.named [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 19:06:57 devstack cinder-volume[83633]: WARNING castellan.key_manager [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 19:06:57 devstack cinder-volume[83633]: WARNING cinder.keymgr.conf_key_mgr [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 19:06:57 devstack cinder-volume[83633]: INFO cinder.volume.manager [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83633) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:06:57 devstack cinder-volume[83633]: INFO oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Starting 1 workers Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Started child 83917 {{(pid=83633) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Full set of CONF: {{(pid=83633) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] ******************************************************************************** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Configuration options gathered from: {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 19:06:57 devstack cinder-volume[83917]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] ================================================================================ {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] allow_availability_zone_fallback = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] allow_compression_on_image_upload = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] allowed_direct_url_schemes = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] api_rate_limit = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] auth_strategy = keystone {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_availability_zone = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_host = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_stats_polling_interval = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backup_api_class = cinder.backup.api.API {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backup_name_template = backup-%s {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backup_use_same_host = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backup_use_temp_snapshot = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] chap_password = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] chap_username = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_internal_tenant_project_id = 2d5a8fc43df14d81aa383fc89084e658 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_internal_tenant_user_id = 3683337fce6e413a996eaeb0a07f278f {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cluster = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] compression_format = gzip {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] compute_api_class = cinder.compute.nova.API {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] config_dir = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] config_source = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] control_exchange = openstack {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] debug = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] default_availability_zone = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] default_group_type = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] default_volume_type = QuobyteHD {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] disk_geometry = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] driver_client_cert = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] driver_client_cert_key = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] driver_data_namespace = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] driver_ssl_cert_path = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] driver_ssl_cert_verify = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] driver_use_ssl = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] enable_new_services = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] enable_unsupported_driver = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] enabled_backends = ['QuobyteHD'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] enforce_multipath_for_image_xfer = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] filter_function = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_api_insecure = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_api_ssl_compression = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_ca_certificates_file = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_catalog_info = image:glance:publicURL {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_certfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_keyfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_num_retries = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance_request_timeout = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] goodness_function = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] graceful_shutdown_timeout = 5 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] group_api_class = cinder.group.api.API {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] host = devstack {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_compress_on_upload = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_conversion_address_space_limit = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_conversion_cpu_limit = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83917]: INFO cinder.volume.manager [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 19:06:57 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.remotefs [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83917) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_conversion_disable = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_upload_use_cinder_backend = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_upload_use_internal_tenant = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_volume_cache_enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_volume_cache_max_count = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] image_volume_cache_max_size_gb = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] init_host_max_objects_retrieval = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] instance_format = [instance: %(uuid)s] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] iscsi_target_flags = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] iscsi_write_cache = on {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] iser_helper = tgtadm {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] iser_ip_address = 192.168.122.89 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] iser_port = 3260 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_color = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_config_append = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_dir = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_file = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_options = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_rotate_interval = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_rotate_interval_type = days {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] log_rotation_type = none {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] max_age = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] max_logfile_count = 30 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] max_logfile_size_mb = 200 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] max_over_subscription_ratio = 20.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] message_reap_interval = 86400 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] message_ttl = 2592000 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] migration_create_volume_timeout_secs = 300 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] monkey_patch = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] monkey_patch_modules = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] my_ip = 192.168.122.89 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] no_snapshot_gb_quota = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] num_iser_scan_tries = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] num_shell_tries = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] num_volume_device_scan_tries = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] nvmeof_conn_info_version = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] nvmet_ns_id = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] nvmet_port_id = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] osapi_max_limit = 1000 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] osapi_volume_ext_list = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] osapi_volume_listen = 0.0.0.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] osapi_volume_listen_port = 8776 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] osapi_volume_use_ssl = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] osapi_volume_workers = 2 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] per_volume_size_limit = -1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] periodic_fuzzy_delay = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] periodic_interval = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] project_id_regex = [0-9a-f\-]+ {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] public_endpoint = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] publish_errors = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] quota_backup_gigabytes = 1000 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] quota_backups = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] quota_gigabytes = 1000 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] quota_groups = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] quota_snapshots = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] quota_volumes = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] rate_limit_burst = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] rate_limit_except_level = CRITICAL {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] rate_limit_interval = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] reinit_driver_count = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] replication_device = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] report_discard_supported = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] report_interval = 120 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] reservation_clean_interval = 86400 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] reservation_expire = 86400 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] reserved_image_namespaces = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] reserved_percentage = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] rpc_response_timeout = 120 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] run_external_periodic_tasks = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] scst_target_driver = iscsi {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] scst_target_iqn_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_down_time = 720 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] shell_completion = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] snapshot_name_template = snapshot-%s {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] split_loggers = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] state_path = /opt/stack/data/cinder {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] storage_availability_zone = nova {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] storage_protocol = iSCSI {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] syslog_log_facility = LOG_USER {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] target_helper = lioadm {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] target_ip_address = 192.168.122.89 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] target_port = 3260 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] target_protocol = iscsi {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] target_secondary_ip_addresses = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] trace_flags = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] transfer_api_class = cinder.transfer.api.API {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] transport_url = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] until_refresh = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] use_chap_auth = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] use_default_quota_class = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] use_journal = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] use_json = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] use_multipath_for_image_xfer = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] use_stderr = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] use_syslog = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] verify_glance_signatures = enabled {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_api_class = cinder.volume.api.API {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_backend_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_clear = zero {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_clear_ionice = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_clear_size = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_copy_bps_limit = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_dd_blocksize = 1M {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_name_template = volume-%s {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_service_inithost_offload = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volume_usage_audit_period = month {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] zoning_mode = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_concurrency.disable_process_locking = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.admin_password = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.admin_token = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.admin_user = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.auth_admin_prefix = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.auth_port = 35357 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.auth_protocol = https {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.auth_section = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.auth_type = password {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.auth_uri = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.auth_version = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.cache = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.certfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.delay_auth_decision = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.http_connect_timeout = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.identity_uri = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.include_service_catalog = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.insecure = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.interface = public {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.keyfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_password = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcache_username = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.region_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.service_token_roles_required = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.service_type = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.token_cache_time = 300 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.backend = dogpile.cache.null {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.backend_argument = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.backend_expiration_time = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.config_prefix = cache.oslo {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.debug_cache_backend = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.enable_retry_client = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.enable_socket_keepalive = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.enforce_fips_mode = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.expiration_time = 600 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.hashclient_retry_attempts = 2 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83917) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 19:06:57 devstack cinder-volume[83917]: WARNING cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 19:06:57 devstack cinder-volume[83917]: WARNING cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.memcache_dead_retry = 300 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.memcache_pool_maxsize = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.memcache_sasl_enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.password = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.proxies = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Running cmd (subprocess): mount.quobyte {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.redis_db = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.redis_sentinel_service_name = mymaster {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.redis_server = localhost:6379 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.retry_attempts = 2 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.retry_delay = 0.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.socket_keepalive_count = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.socket_keepalive_idle = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.socket_keepalive_interval = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.socket_timeout = 1.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.tls_allowed_ciphers = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.tls_cafile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.tls_certfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.tls_enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.tls_keyfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cache.username = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] coordination.backend_url = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.asyncio_connection = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.asyncio_slave_connection = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.backend = sqlalchemy {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.connection = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.connection_debug = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.connection_parameters = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.connection_recycle_time = 3600 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.connection_trace = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.db_inc_retry_interval = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.db_max_retries = 20 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.db_max_retry_interval = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.db_retry_interval = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.max_overflow = 50 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.max_pool_size = 5 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.max_retries = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.mysql_wsrep_sync_wait = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.pool_timeout = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.retry_interval = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.slave_connection = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.sqlite_synchronous = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.synchronous_reader = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] database.use_db_reconnect = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.connection_string = messaging:// {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.es_doc_type = notification {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.es_scroll_size = 10000 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.es_scroll_time = 2m {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.filter_error_trace = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.hmac_keys = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.sentinel_service_name = mymaster {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.socket_timeout = 0.1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.trace_requests = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler.trace_sqlalchemy = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler_jaeger.process_tags = {} {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler_jaeger.service_name_prefix = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] profiler_otlp.service_name_prefix = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.enforce_new_defaults = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: WARNING oslo_config.cfg [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.enforce_scope = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.policy_default_rule = default {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.policy_file = policy.yaml {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_policy.remote_timeout = 60.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] privsep_osbrick.group = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] privsep_osbrick.helper_command = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] privsep_osbrick.user = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_sys_admin.group = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_sys_admin.helper_command = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] cinder_sys_admin.user = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.auth_section = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.auth_type = password {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.cafile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.certfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.collect_timing = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.insecure = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.keyfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.send_service_user_token = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.split_loggers = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] service_user.timeout = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.auth_section = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.auth_type = password {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.certfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.collect_timing = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.insecure = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.keyfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.region_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.split_loggers = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] glance.timeout = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.backend_availability_zone = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.chap_password = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.chap_username = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.disk_geometry = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.driver_client_cert = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.driver_client_cert_key = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.driver_data_namespace = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.driver_use_ssl = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.enable_unsupported_driver = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.extra_capabilities = {} {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.filter_function = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.goodness_function = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.iscsi_target_flags = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.iscsi_write_cache = on {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.iser_helper = tgtadm {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.iser_port = 3260 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_host = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_login = admin {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_mount_options = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_password = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_private_key = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_share_path = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_ssh_port = 22 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.num_shell_tries = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.nvmet_port_id = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.quobyte_client_cfg = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.quobyte_volume_url = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.replication_device = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.report_discard_supported = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.reserved_percentage = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.scst_target_driver = iscsi {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.scst_target_iqn_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.storage_protocol = iSCSI {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.target_helper = tgtadm {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.target_port = 3260 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.target_protocol = iscsi {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.trace_flags = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.unique_fqdn_network = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.use_chap_auth = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volume_backend_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volume_clear = zero {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volume_clear_ionice = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volume_clear_size = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_reports.file_event_handler = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_reports.log_dir = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.backend_availability_zone = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.backend_host = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.chap_password = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.chap_username = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.chiscsi_conf = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.disk_geometry = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.driver_client_cert = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.driver_client_cert_key = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.driver_data_namespace = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.driver_use_ssl = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.extra_capabilities = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack quobyte-client[83922]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 19:06:57 devstack quobyte-client[83922]: Invalid parameters found, error: missing mount point. Apr 29 19:06:57 devstack quobyte-client[83922]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 19:06:57 devstack quobyte-client[83922]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.filter_function = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.goodness_function = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] CMD "mount.quobyte" returned: 1 in 0.217s {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:57 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:57 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.iscsi_target_flags = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.iscsi_write_cache = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.iser_helper = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.iser_ip_address = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.iser_port = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=83917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.iser_target_prefix = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_host = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_login = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83917]: INFO cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 ... Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_mount_options = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_password = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 -c /etc/quobyte/client-cinder.cfg {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_private_key = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_share_path = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_ssh_port = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.num_shell_tries = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nvmet_ns_id = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.nvmet_port_id = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.replication_device = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.report_discard_supported = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.reserved_percentage = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.scst_target_driver = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.storage_protocol = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.target_helper = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.target_ip_address = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.target_port = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.target_prefix = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.target_protocol = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.trace_flags = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.unique_fqdn_network = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.use_chap_auth = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volume_clear = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volume_clear_ionice = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volume_clear_size = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] QuobyteHD.volumes_dir = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.ssl = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.ssl_version = {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_notifications.driver = [] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_notifications.retry = -1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack sudo[83923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 -c /etc/quobyte/client-cinder.cfg Apr 29 19:06:57 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] oslo_messaging_notifications.transport_url = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] key_manager.fixed_key = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.barbican_api_version = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.barbican_endpoint = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.barbican_endpoint_type = public {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.barbican_region_name = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.cafile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.certfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.collect_timing = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.insecure = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.keyfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.number_of_retries = 60 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.retry_delay = 1 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.send_service_user_token = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.split_loggers = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.timeout = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.verify_ssl = True {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican.verify_ssl_path = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.auth_section = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.auth_type = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.cafile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.certfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.collect_timing = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.insecure = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.keyfile = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.split_loggers = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] barbican_service_user.timeout = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.approle_role_id = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.approle_secret_id = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.kv_mountpoint = secret {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.kv_path = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.kv_version = 2 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.namespace = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.root_token_id = **** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.ssl_ca_crt_file = None {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.timeout = 60.0 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.use_ssl = False {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:06:57 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] ******************************************************************************** {{(pid=83633) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 19:06:58 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:58 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.800s {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:58 devstack cinder-volume[83917]: INFO cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 succeeded Apr 29 19:06:58 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=83917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:58 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.820s {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:58 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:58 devstack sudo[84009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:06:58 devstack sudo[84009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:59 devstack sudo[84009]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.622s {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:59 devstack cinder-volume[83917]: INFO cinder.volume.driver [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG cinder.volume.driver [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5423545837402, 'free_capacity_gb': 1775.5423545837402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83917) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG oslo_db.sqlalchemy.engines [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83917) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG dbcounter [-] [83917] Writer thread running {{(pid=83917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG cinder.db.sqlalchemy.api [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Building query based on filter {{(pid=83917) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG cinder.image.image_utils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83917) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 19:06:59 devstack cinder-volume[83917]: INFO cinder.keymgr.migration [None req-0f7eb3ff-3ff3-43e9-a32c-e60be8f1a67c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=83917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=83917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:06:59 devstack sudo[84034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:06:59 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:06:59 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.618s {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG cinder.manager [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Notifying Schedulers of capabilities ... {{(pid=83917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:06:59 devstack cinder-volume[83917]: INFO cinder.volume.manager [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Driver initialization completed successfully. Apr 29 19:06:59 devstack cinder-volume[83917]: INFO cinder.manager [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Initiating service 3 cleanup Apr 29 19:06:59 devstack cinder-volume[83917]: INFO cinder.manager [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Service 3 cleanup completed. Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG cinder.service [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Creating RPC server for service cinder-volume {{(pid=83917) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 19:06:59 devstack cinder-volume[83917]: DEBUG cinder.service [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83917) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 19:07:00 devstack cinder-volume[83917]: INFO cinder.volume.manager [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 19:07:00 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:00 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:00 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=83917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:00 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=83917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:00 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:00 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:00 devstack sudo[84056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:07:00 devstack sudo[84056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:00 devstack sudo[84056]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:00 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.826s {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:01 devstack cinder-volume[83917]: INFO cinder.volume.manager [None req-485dcc96-67f5-4b15-9bad-f4e48935d0f2 None None] Driver post RPC initialization completed successfully. Apr 29 19:07:04 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-c6f03dcc-fec3-4957-aa26-16f50e2faa83 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:04 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-c6f03dcc-fec3-4957-aa26-16f50e2faa83 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:04 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-c6f03dcc-fec3-4957-aa26-16f50e2faa83 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=83917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:05 devstack cinder-volume[83917]: DEBUG cinder.volume.drivers.quobyte [None req-c6f03dcc-fec3-4957-aa26-16f50e2faa83 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=83917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:05 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-c6f03dcc-fec3-4957-aa26-16f50e2faa83 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:05 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-c6f03dcc-fec3-4957-aa26-16f50e2faa83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:05 devstack sudo[84197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:07:05 devstack sudo[84197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:05 devstack sudo[84197]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:05 devstack cinder-volume[83917]: DEBUG oslo_concurrency.processutils [None req-c6f03dcc-fec3-4957-aa26-16f50e2faa83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.560s {{(pid=83917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:05 devstack cinder-volume[83917]: DEBUG cinder.manager [None req-c6f03dcc-fec3-4957-aa26-16f50e2faa83 None None] Notifying Schedulers of capabilities ... {{(pid=83917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:07:07 devstack cinder-volume[83633]: DEBUG dbcounter [-] [83633] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83633) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:07:07 devstack cinder-volume[83633]: INFO oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Caught SIGTERM, stopping children Apr 29 19:07:07 devstack cinder-volume[83633]: DEBUG oslo_concurrency.lockutils [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Acquiring lock "singleton_lock" {{(pid=83633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 19:07:07 devstack cinder-volume[83633]: DEBUG oslo_concurrency.lockutils [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Acquired lock "singleton_lock" {{(pid=83633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 19:07:07 devstack cinder-volume[83633]: DEBUG oslo_concurrency.lockutils [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Releasing lock "singleton_lock" {{(pid=83633) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 19:07:07 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Stop services. {{(pid=83633) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 19:07:07 devstack cinder-volume[83633]: DEBUG oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Killing children. {{(pid=83633) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 19:07:07 devstack cinder-volume[83633]: INFO oslo_service.backend._eventlet.service [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Waiting on 1 children to exit Apr 29 19:07:09 devstack cinder-volume[83917]: DEBUG dbcounter [-] [83917] Writing DB stats cinder:SELECT=3 {{(pid=83917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:07:10 devstack cinder-volume[83917]: DEBUG dbcounter [-] [83917] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:07:12 devstack cinder-volume[83917]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 29 19:07:13 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Acquiring lock "singleton_lock" {{(pid=83917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 19:07:13 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Acquired lock "singleton_lock" {{(pid=83917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 19:07:13 devstack cinder-volume[83917]: DEBUG oslo_concurrency.lockutils [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Releasing lock "singleton_lock" {{(pid=83917) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 19:07:13 devstack cinder-volume[83917]: WARNING amqp [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 19:07:13 devstack cinder-volume[83917]: WARNING amqp [None req-5c6b374a-3a24-45a1-853d-5c1e11d5249c None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 19:07:16 devstack cinder-volume[84272]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 19:07:16 devstack cinder-volume[84272]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 19:07:16 devstack cinder-volume[84272]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84272) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 19:07:16 devstack cinder-volume[84272]: INFO dbcounter [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Registered counter for database cinder Apr 29 19:07:16 devstack cinder-volume[84272]: DEBUG oslo_db.sqlalchemy.engines [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG dbcounter [-] [84272] Writer thread running {{(pid=84272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 19:07:17 devstack cinder-volume[84272]: INFO cinder.rpc [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 19:07:17 devstack cinder-volume[84272]: INFO cinder.rpc [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_db.sqlalchemy.engines [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:07:17 devstack cinder-volume[84272]: INFO cinder.volume.manager [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Determined volume DB was empty at startup. Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG cinder.volume.manager [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84272) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 29 19:07:17 devstack cinder-volume[84272]: WARNING stevedore.named [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 19:07:17 devstack cinder-volume[84272]: WARNING castellan.key_manager [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 19:07:17 devstack cinder-volume[84272]: WARNING cinder.keymgr.conf_key_mgr [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 19:07:17 devstack cinder-volume[84272]: INFO cinder.volume.manager [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_db.sqlalchemy.engines [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:07:17 devstack cinder-volume[84272]: INFO oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Starting 1 workers Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Started child 84523 {{(pid=84272) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Full set of CONF: {{(pid=84272) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] ******************************************************************************** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Configuration options gathered from: {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] ================================================================================ {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] allow_availability_zone_fallback = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] allow_compression_on_image_upload = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] allowed_direct_url_schemes = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] api_rate_limit = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] auth_strategy = keystone {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_availability_zone = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84523]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_host = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_stats_polling_interval = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backup_api_class = cinder.backup.api.API {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backup_name_template = backup-%s {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backup_use_same_host = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backup_use_temp_snapshot = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] chap_password = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] chap_username = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_internal_tenant_project_id = 2d5a8fc43df14d81aa383fc89084e658 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_internal_tenant_user_id = 3683337fce6e413a996eaeb0a07f278f {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cluster = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] compression_format = gzip {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] compute_api_class = cinder.compute.nova.API {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] config_dir = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] config_source = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] control_exchange = openstack {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] debug = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] default_availability_zone = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] default_group_type = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] default_volume_type = QuobyteHD {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] disk_geometry = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] driver_client_cert = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] driver_client_cert_key = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] driver_data_namespace = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] driver_ssl_cert_path = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] driver_ssl_cert_verify = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] driver_use_ssl = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] enable_new_services = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] enable_unsupported_driver = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] enabled_backends = ['QuobyteHD'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] enforce_multipath_for_image_xfer = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] filter_function = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_api_insecure = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_api_servers = ['http://192.168.122.89/image'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_api_ssl_compression = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_ca_certificates_file = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_catalog_info = image:glance:publicURL {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_certfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_keyfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_num_retries = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance_request_timeout = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] goodness_function = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] graceful_shutdown_timeout = 5 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] group_api_class = cinder.group.api.API {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] host = devstack {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_compress_on_upload = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_conversion_address_space_limit = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_conversion_cpu_limit = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_conversion_disable = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_upload_use_cinder_backend = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_upload_use_internal_tenant = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_volume_cache_enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_volume_cache_max_count = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] image_volume_cache_max_size_gb = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] init_host_max_objects_retrieval = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] instance_format = [instance: %(uuid)s] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] iscsi_target_flags = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] iscsi_write_cache = on {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] iser_helper = tgtadm {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] iser_ip_address = 192.168.122.89 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] iser_port = 3260 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_color = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_config_append = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_dir = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_file = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_options = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_rotate_interval = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_rotate_interval_type = days {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] log_rotation_type = none {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] max_age = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] max_logfile_count = 30 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] max_logfile_size_mb = 200 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] max_over_subscription_ratio = 20.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] message_reap_interval = 86400 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] message_ttl = 2592000 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] migration_create_volume_timeout_secs = 300 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] monkey_patch = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] monkey_patch_modules = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] my_ip = 192.168.122.89 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] no_snapshot_gb_quota = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] num_iser_scan_tries = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] num_shell_tries = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] num_volume_device_scan_tries = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] nvmeof_conn_info_version = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] nvmet_ns_id = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] nvmet_port_id = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] osapi_max_limit = 1000 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] osapi_volume_ext_list = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] osapi_volume_listen_port = 8776 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] osapi_volume_use_ssl = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] osapi_volume_workers = 2 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] per_volume_size_limit = -1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] periodic_fuzzy_delay = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] periodic_interval = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] public_endpoint = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] publish_errors = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] quota_backup_gigabytes = 1000 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] quota_backups = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] quota_gigabytes = 1000 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] quota_groups = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] quota_snapshots = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] quota_volumes = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] rate_limit_burst = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] rate_limit_except_level = CRITICAL {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] rate_limit_interval = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] reinit_driver_count = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] replication_device = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] report_discard_supported = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] report_interval = 120 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] reservation_clean_interval = 86400 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] reservation_expire = 86400 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] reserved_image_namespaces = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] reserved_percentage = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84523) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] rpc_response_timeout = 120 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] run_external_periodic_tasks = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] scst_target_driver = iscsi {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] scst_target_iqn_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_down_time = 720 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] shell_completion = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] snapshot_name_template = snapshot-%s {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] split_loggers = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] state_path = /opt/stack/data/cinder {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] storage_availability_zone = nova {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] storage_protocol = iSCSI {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] syslog_log_facility = LOG_USER {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] target_helper = lioadm {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] target_ip_address = 192.168.122.89 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] target_port = 3260 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] target_protocol = iscsi {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] target_secondary_ip_addresses = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] trace_flags = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] transport_url = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] until_refresh = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] use_chap_auth = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] use_default_quota_class = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] use_journal = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] use_json = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] use_multipath_for_image_xfer = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] use_stderr = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] use_syslog = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] verify_glance_signatures = enabled {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_api_class = cinder.volume.api.API {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_backend_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_clear = zero {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_clear_ionice = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_clear_size = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_copy_bps_limit = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_dd_blocksize = 1M {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_name_template = volume-%s {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_service_inithost_offload = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volume_usage_audit_period = month {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] zoning_mode = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_concurrency.disable_process_locking = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.admin_password = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.admin_token = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.admin_user = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.auth_admin_prefix = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.auth_port = 35357 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.auth_protocol = https {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.auth_section = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.auth_type = password {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.auth_uri = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.auth_version = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.cache = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.certfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.identity_uri = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.include_service_catalog = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.insecure = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.interface = public {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.keyfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_password = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcache_username = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.region_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.service_type = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.89/identity {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.backend = dogpile.cache.null {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.backend_argument = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.backend_expiration_time = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.config_prefix = cache.oslo {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.debug_cache_backend = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.enable_retry_client = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.enable_socket_keepalive = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.enforce_fips_mode = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.expiration_time = 600 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.hashclient_retry_attempts = 2 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.memcache_dead_retry = 300 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.memcache_pool_maxsize = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.memcache_sasl_enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.password = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.proxies = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.redis_db = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.redis_sentinel_service_name = mymaster {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.redis_server = localhost:6379 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.retry_attempts = 2 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.retry_delay = 0.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.socket_keepalive_count = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.socket_keepalive_idle = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.socket_keepalive_interval = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.socket_timeout = 1.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.tls_allowed_ciphers = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.tls_cafile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.tls_certfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.tls_enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.tls_keyfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cache.username = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] coordination.backend_url = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.asyncio_connection = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.asyncio_slave_connection = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.backend = sqlalchemy {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.connection = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.connection_debug = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.connection_parameters = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.connection_recycle_time = 3600 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.connection_trace = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.db_inc_retry_interval = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.db_max_retries = 20 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.db_max_retry_interval = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.db_retry_interval = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.max_overflow = 50 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.max_pool_size = 5 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.max_retries = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.mysql_wsrep_sync_wait = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.pool_timeout = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.retry_interval = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.slave_connection = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.sqlite_synchronous = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.synchronous_reader = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] database.use_db_reconnect = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.connection_string = messaging:// {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.es_doc_type = notification {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.es_scroll_size = 10000 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.es_scroll_time = 2m {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.filter_error_trace = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.hmac_keys = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.sentinel_service_name = mymaster {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.socket_timeout = 0.1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.trace_requests = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler.trace_sqlalchemy = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler_jaeger.process_tags = {} {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler_jaeger.service_name_prefix = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] profiler_otlp.service_name_prefix = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.enforce_new_defaults = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: WARNING oslo_config.cfg [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.enforce_scope = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.policy_default_rule = default {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.policy_file = policy.yaml {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_policy.remote_timeout = 60.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] privsep_osbrick.group = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] privsep_osbrick.helper_command = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] privsep_osbrick.user = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_sys_admin.group = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_sys_admin.helper_command = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] cinder_sys_admin.user = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.auth_section = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.auth_type = password {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.cafile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.certfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.collect_timing = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.insecure = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.keyfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.send_service_user_token = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.split_loggers = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] service_user.timeout = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.auth_section = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.auth_type = password {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.certfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.collect_timing = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.insecure = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.keyfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.region_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.split_loggers = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] glance.timeout = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.backend_availability_zone = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.chap_password = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.chap_username = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.disk_geometry = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.driver_client_cert = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.driver_client_cert_key = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.driver_data_namespace = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.driver_use_ssl = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.extra_capabilities = {} {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.filter_function = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84523) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 19:07:17 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 19:07:17 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.goodness_function = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.iscsi_target_flags = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.iscsi_write_cache = on {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.iser_helper = tgtadm {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.iser_ip_address = 192.168.122.89 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.iser_port = 3260 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Running cmd (subprocess): mount.quobyte {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_host = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_login = admin {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_mount_options = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_password = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_private_key = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_share_path = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_ssh_port = 22 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.num_shell_tries = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.quobyte_client_cfg = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.quobyte_volume_url = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.replication_device = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.report_discard_supported = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.reserved_percentage = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.target_helper = tgtadm {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.target_ip_address = 192.168.122.89 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.target_port = 3260 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.target_protocol = iscsi {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.trace_flags = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.unique_fqdn_network = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.use_chap_auth = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volume_backend_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volume_clear = zero {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volume_clear_ionice = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volume_clear_size = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_reports.file_event_handler = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_reports.log_dir = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.backend_availability_zone = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.backend_host = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.chap_password = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.chap_username = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.chiscsi_conf = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.disk_geometry = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.driver_client_cert = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.driver_client_cert_key = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.driver_data_namespace = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.driver_use_ssl = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.extra_capabilities = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.filter_function = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.goodness_function = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.iscsi_target_flags = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.iscsi_write_cache = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.iser_helper = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.iser_ip_address = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.iser_port = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.iser_target_prefix = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_host = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_login = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_mount_options = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_password = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_private_key = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_share_path = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_ssh_port = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.num_shell_tries = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nvmet_ns_id = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.nvmet_port_id = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.replication_device = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.report_discard_supported = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.reserved_percentage = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.scst_target_driver = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.storage_protocol = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.target_helper = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.target_ip_address = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.target_port = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.target_prefix = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.target_protocol = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.trace_flags = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.unique_fqdn_network = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.use_chap_auth = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volume_clear = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volume_clear_ionice = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volume_clear_size = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] QuobyteHD.volumes_dir = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.ssl = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_notifications.driver = [] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_notifications.retry = -1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] key_manager.fixed_key = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.barbican_api_version = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.barbican_endpoint = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.barbican_endpoint_type = public {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.barbican_region_name = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.cafile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.certfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.collect_timing = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.insecure = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.keyfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.number_of_retries = 60 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.retry_delay = 1 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.send_service_user_token = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.split_loggers = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.timeout = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.verify_ssl = True {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican.verify_ssl_path = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.auth_section = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.auth_type = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.cafile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.certfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.collect_timing = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.insecure = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.keyfile = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.split_loggers = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] barbican_service_user.timeout = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.approle_role_id = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.approle_secret_id = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.kv_mountpoint = secret {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.kv_path = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.kv_version = 2 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.namespace = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.root_token_id = **** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.ssl_ca_crt_file = None {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.timeout = 60.0 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.use_ssl = False {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 19:07:17 devstack cinder-volume[84272]: DEBUG oslo_service.backend._eventlet.service [None req-4d984a44-61ea-4f7a-9bf7-75eb9ad15c38 None None] ******************************************************************************** {{(pid=84272) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 19:07:17 devstack quobyte-client[84529]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 19:07:17 devstack quobyte-client[84529]: Invalid parameters found, error: missing mount point. Apr 29 19:07:17 devstack quobyte-client[84529]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 19:07:17 devstack quobyte-client[84529]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] CMD "mount.quobyte" returned: 1 in 0.099s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:17 devstack sudo[84530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:07:17 devstack sudo[84530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:18 devstack sudo[84530]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.603s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:18 devstack cinder-volume[84523]: INFO cinder.volume.driver [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG cinder.volume.driver [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5423545837402, 'free_capacity_gb': 1775.5423545837402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84523) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG oslo_db.sqlalchemy.engines [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writer thread running {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG cinder.db.sqlalchemy.api [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Building query based on filter {{(pid=84523) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84523) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:18 devstack cinder-volume[84523]: INFO cinder.keymgr.migration [None req-2128a065-e2ed-4a76-9b85-05cc1fd2393b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 19:07:18 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:07:18 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:18 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.615s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:18 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:07:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Driver initialization completed successfully. Apr 29 19:07:18 devstack cinder-volume[84523]: INFO cinder.manager [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Initiating service 3 cleanup Apr 29 19:07:19 devstack cinder-volume[84523]: INFO cinder.manager [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Service 3 cleanup completed. Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG cinder.service [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Creating RPC server for service cinder-volume {{(pid=84523) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG cinder.service [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84523) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 19:07:19 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:07:19 devstack sudo[84567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:07:19 devstack sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:07:19 devstack sudo[84567]: pam_unix(sudo:session): session closed for user root Apr 29 19:07:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.620s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:07:19 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1bb9431a-0607-4b49-82e7-5b8023370a45 None None] Driver post RPC initialization completed successfully. Apr 29 19:07:27 devstack cinder-volume[84272]: DEBUG dbcounter [-] [84272] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84272) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:07:29 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=2 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:07:29 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:07:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:07:29 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 6 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:07:29 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Flow 'volume_create_manager' (0d0023ac-1585-418d-9432-7048033ffdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ac030b-3e1d-475b-9f4b-c3c23d0d5b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ac030b-3e1d-475b-9f4b-c3c23d0d5b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-485237874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371e38f8-229f-4297-8afe-eda671600446,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f2130b83b6c496787e062cda4b993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:17Z,use_quota=True,user_id='095438f975a64b01a4cca19510c2514a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9303487-e0ca-4fa9-a030-3ace9a94d609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9303487-e0ca-4fa9-a030-3ace9a94d609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516597b6-d0d2-4f6d-a3a0-70ae8a772953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516597b6-d0d2-4f6d-a3a0-70ae8a772953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371e38f8-229f-4297-8afe-eda671600446', 'volume_name': 'volume-371e38f8-229f-4297-8afe-eda671600446', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb470aa5-9a9c-4b95-b8f6-e2e3fd8b1716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb470aa5-9a9c-4b95-b8f6-e2e3fd8b1716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872e308f-a2e7-4406-b0d4-be772ccdefe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:16 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Volume 371e38f8-229f-4297-8afe-eda671600446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371e38f8-229f-4297-8afe-eda671600446', 'volume_size': 1} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-485237874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371e38f8-229f-4297-8afe-eda671600446,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f2130b83b6c496787e062cda4b993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:17Z,use_quota=True,user_id='095438f975a64b01a4cca19510c2514a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Creating volume 371e38f8-229f-4297-8afe-eda671600446 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:08:16 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:08:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:17 devstack sudo[84839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 1073741824 Apr 29 19:08:17 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:17 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 1073741824" returned: 0 in 0.897s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:17 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 Apr 29 19:08:17 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:18 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446" returned: 0 in 0.754s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:08:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872e308f-a2e7-4406-b0d4-be772ccdefe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371e38f8-229f-4297-8afe-eda671600446', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f441c7a-ffbc-4b00-af3a-0158dc999b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:18 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Volume volume-371e38f8-229f-4297-8afe-eda671600446 (371e38f8-229f-4297-8afe-eda671600446): created successfully Apr 29 19:08:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f441c7a-ffbc-4b00-af3a-0158dc999b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Flow 'volume_create_manager' (0d0023ac-1585-418d-9432-7048033ffdfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-470aaf94-dd57-4742-8b15-d7af6a5001e4 tempest-VolumesTestJSON-923050049 None] Created volume successfully. Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Flow 'volume_create_manager' (b9748cbb-5294-4f6b-a50a-562fe4da235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345ecde1-5c17-4db3-b110-1c06bc2b45ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345ecde1-5c17-4db3-b110-1c06bc2b45ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2002667015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310f8d45-d479-46a7-b83f-94f8cf578625,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f2130b83b6c496787e062cda4b993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:20Z,use_quota=True,user_id='095438f975a64b01a4cca19510c2514a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f0310e-0d33-4fa9-8fc4-47e9d7e7f9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f0310e-0d33-4fa9-8fc4-47e9d7e7f9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf205cb-99ac-4100-86a3-443695c6f7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf205cb-99ac-4100-86a3-443695c6f7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310f8d45-d479-46a7-b83f-94f8cf578625', 'volume_name': 'volume-310f8d45-d479-46a7-b83f-94f8cf578625', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a65569-02ce-47b6-b409-848db035fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a65569-02ce-47b6-b409-848db035fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67e8c13-e410-4c0e-97f6-da1432d4ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:20 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Volume 310f8d45-d479-46a7-b83f-94f8cf578625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310f8d45-d479-46a7-b83f-94f8cf578625', 'volume_size': 1} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2002667015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310f8d45-d479-46a7-b83f-94f8cf578625,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f2130b83b6c496787e062cda4b993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:20Z,use_quota=True,user_id='095438f975a64b01a4cca19510c2514a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Creating volume 310f8d45-d479-46a7-b83f-94f8cf578625 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:08:20 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:08:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:20 devstack sudo[85170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 1073741824 Apr 29 19:08:20 devstack sudo[85170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:21 devstack sudo[85170]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 1073741824" returned: 0 in 1.195s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:21 devstack sudo[85238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 Apr 29 19:08:21 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:22 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625" returned: 0 in 0.962s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:08:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67e8c13-e410-4c0e-97f6-da1432d4ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310f8d45-d479-46a7-b83f-94f8cf578625', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9aefe9-6b7e-4717-9463-40d07a6a654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:22 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Volume volume-310f8d45-d479-46a7-b83f-94f8cf578625 (310f8d45-d479-46a7-b83f-94f8cf578625): created successfully Apr 29 19:08:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9aefe9-6b7e-4717-9463-40d07a6a654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Flow 'volume_create_manager' (b9748cbb-5294-4f6b-a50a-562fe4da235d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:22 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-96d50370-358b-464a-a4ab-13ac3512be04 tempest-VolumesTestJSON-923050049 None] Created volume successfully. Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Flow 'volume_create_manager' (777d2177-343c-408b-b0a5-d6fbe2957c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90243be9-a564-4820-a038-cfe83a192c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90243be9-a564-4820-a038-cfe83a192c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-453225631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f2130b83b6c496787e062cda4b993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:24Z,use_quota=True,user_id='095438f975a64b01a4cca19510c2514a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f027ab-e8ce-479d-abf9-d0128b5ed107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f027ab-e8ce-479d-abf9-d0128b5ed107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffccc47-9ac0-4934-899c-858657750122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffccc47-9ac0-4934-899c-858657750122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480', 'volume_name': 'volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d494bbb0-6060-44e9-b7ef-0ed3b6e37a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d494bbb0-6060-44e9-b7ef-0ed3b6e37a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1714e04e-2529-425f-b958-2fb764d52798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:24 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Volume 5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480', 'volume_size': 1} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-453225631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f2130b83b6c496787e062cda4b993da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:24Z,use_quota=True,user_id='095438f975a64b01a4cca19510c2514a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Creating volume 5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:08:24 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:08:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:24 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 1073741824 Apr 29 19:08:24 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:26 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 1073741824" returned: 0 in 2.028s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:26 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 Apr 29 19:08:26 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Flow 'volume_create_manager' (310ee050-612a-436c-a852-2401fc2e9172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e1455a-34d5-4235-b97d-599cc94a6660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e1455a-34d5-4235-b97d-599cc94a6660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-579327629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce59d16-7340-47b0-95f9-b076067b6e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a47fee3c02c4b8fa7aec9a33825a75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:27Z,use_quota=True,user_id='c2c641cc5ad2431b96ffd2bbd3da1125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a8d1b4-177d-470d-a24a-d98b183236cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a8d1b4-177d-470d-a24a-d98b183236cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1357d57-3752-4182-a5d5-a60b07c4ebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1357d57-3752-4182-a5d5-a60b07c4ebb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce59d16-7340-47b0-95f9-b076067b6e45', 'volume_name': 'volume-0ce59d16-7340-47b0-95f9-b076067b6e45', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5072eac5-aedf-4d14-bdf3-a024564cb015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5072eac5-aedf-4d14-bdf3-a024564cb015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edde3153-09cd-4662-8cbc-9c9e122586ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:27 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Volume 0ce59d16-7340-47b0-95f9-b076067b6e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce59d16-7340-47b0-95f9-b076067b6e45', 'volume_size': 1} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:27 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480" returned: 0 in 1.190s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] <== create_volume: return (3319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.325s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-579327629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce59d16-7340-47b0-95f9-b076067b6e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a47fee3c02c4b8fa7aec9a33825a75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:27Z,use_quota=True,user_id='c2c641cc5ad2431b96ffd2bbd3da1125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Creating volume 0ce59d16-7340-47b0-95f9-b076067b6e45 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:08:27 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:27 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 1073741824 Apr 29 19:08:27 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1714e04e-2529-425f-b958-2fb764d52798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb181d3b-7256-48ef-a57d-ebd6b1db9837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:27 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Volume volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 (5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480): created successfully Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb181d3b-7256-48ef-a57d-ebd6b1db9837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Flow 'volume_create_manager' (777d2177-343c-408b-b0a5-d6fbe2957c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:27 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-df0e748a-4e23-4399-867f-213151a2f2bb tempest-VolumesTestJSON-923050049 None] Created volume successfully. Apr 29 19:08:29 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 1073741824" returned: 0 in 1.822s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:29 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 Apr 29 19:08:29 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:29 devstack sudo[85272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:08:29 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:30 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45" returned: 0 in 1.086s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] <== create_volume: return (2994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:08:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edde3153-09cd-4662-8cbc-9c9e122586ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce59d16-7340-47b0-95f9-b076067b6e45', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7fa601-607f-42b6-9477-a792bd70732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:30 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Volume volume-0ce59d16-7340-47b0-95f9-b076067b6e45 (0ce59d16-7340-47b0-95f9-b076067b6e45): created successfully Apr 29 19:08:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7fa601-607f-42b6-9477-a792bd70732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Flow 'volume_create_manager' (310ee050-612a-436c-a852-2401fc2e9172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:30 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-70c3ba5c-0460-42ed-90e1-7be35598fe62 tempest-VolumesAdminNegativeTest-2026127591 None] Created volume successfully. Apr 29 19:08:31 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.427s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 6 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Acquiring lock "cinder-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Lock "cinder-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Acquiring lock "cinder-quobyte-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Lock "cinder-quobyte-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480" acquired by "delete_volume" :: waited 0.059s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:31 devstack cinder-volume[84523]: INFO oslo.privsep.daemon [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps82nhy1s/privsep.sock'] Apr 29 19:08:31 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps82nhy1s/privsep.sock Apr 29 19:08:31 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Acquiring lock "cinder-0ce59d16-7340-47b0-95f9-b076067b6e45-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "cinder-0ce59d16-7340-47b0-95f9-b076067b6e45-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Acquiring lock "cinder-quobyte-0ce59d16-7340-47b0-95f9-b076067b6e45" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "cinder-quobyte-0ce59d16-7340-47b0-95f9-b076067b6e45" acquired by "delete_volume" :: waited 0.055s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:34 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:34 devstack cinder-volume[84523]: INFO oslo.privsep.daemon [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Spawned new privsep daemon via rootwrap Apr 29 19:08:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Accepted privsep connection to /tmp/tmps82nhy1s/privsep.sock {{(pid=84523) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 19:08:34 devstack cinder-volume[84523]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 19:08:34 devstack cinder-volume[84523]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 19:08:34 devstack cinder-volume[84523]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 19:08:34 devstack cinder-volume[84523]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85288 Apr 29 19:08:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f2b00-0419-4817-902b-bcdc805174a2]: (2,) {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:34 devstack cinder-volume[84523]: WARNING oslo_privsep.priv_context [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] privsep daemon already running Apr 29 19:08:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[358bd30c-053a-42c9-a4f6-b18c3c2b911f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dbe6d2-edc3-4fb3-bec1-bd8b77c34bd9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:34 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 Apr 29 19:08:34 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:34 devstack sudo[85311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 Apr 29 19:08:34 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:35 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480" returned: 0 in 1.272s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:35 devstack sudo[85318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480 Apr 29 19:08:35 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:36 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45" returned: 0 in 2.184s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:36 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45 Apr 29 19:08:36 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:37 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480" returned: 0 in 1.562s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Lock "cinder-quobyte-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480" released by "delete_volume" :: held 5.551s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:37 devstack cinder-volume[84523]: WARNING cinder.quota [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:08:37 devstack cinder-volume[84523]: WARNING cinder.quota [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Created reservations ['1def09ea-6d95-46fc-bccf-a43b742131df', 'cf7d14ad-d733-4e8d-a04b-b8c6b315577a', '0f104347-c7c5-4101-9f2b-c46767827614', 'd1bb03bc-85c3-4873-a8cb-3205b246341a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:37 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:08:37 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:37 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0ce59d16-7340-47b0-95f9-b076067b6e45" returned: 0 in 1.426s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "cinder-quobyte-0ce59d16-7340-47b0-95f9-b076067b6e45" released by "delete_volume" :: held 5.545s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:38 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Created reservations ['41e7a59f-6e4c-46dd-89a0-16f38af6f09c', 'dcd64c3d-143a-42c8-a241-7185e283bb27', '47f7c898-d1c4-46bc-8ae6-b94669ca0119', '4adc5c9c-d52c-4bfa-8bab-60baa3a21428'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:38 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:08:38 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Acquiring lock "cinder-310f8d45-d479-46a7-b83f-94f8cf578625-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Lock "cinder-310f8d45-d479-46a7-b83f-94f8cf578625-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Acquiring lock "cinder-quobyte-310f8d45-d479-46a7-b83f-94f8cf578625" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Lock "cinder-quobyte-310f8d45-d479-46a7-b83f-94f8cf578625" acquired by "delete_volume" :: waited 0.056s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe818709-8956-404f-a9c9-3f116cce98e6]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:39 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 Apr 29 19:08:39 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:39 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 2.218s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:40 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:08:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Deleted volume successfully. Apr 29 19:08:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f4bbd534-fde3-4c58-bc5c-2aa85a99e062 tempest-VolumesTestJSON-923050049 None] Lock "cinder-5a1d7054-ac4b-4740-9c4f-2b3b8ff9a480-delete_volume" released by "delete_volume" :: held 8.663s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:40 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 2.612s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:40 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:08:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Deleted volume successfully. Apr 29 19:08:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-efb2d8e2-11de-429a-8942-f5cd0fc3c4f4 tempest-VolumesAdminNegativeTest-2026127591 None] Lock "cinder-0ce59d16-7340-47b0-95f9-b076067b6e45-delete_volume" released by "delete_volume" :: held 8.639s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:41 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625" returned: 0 in 1.709s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:41 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625 Apr 29 19:08:41 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:41 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-310f8d45-d479-46a7-b83f-94f8cf578625" returned: 0 in 0.752s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Lock "cinder-quobyte-310f8d45-d479-46a7-b83f-94f8cf578625" released by "delete_volume" :: held 2.684s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:41 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Created reservations ['e77eeba9-44b8-437d-999d-2cef254001da', '28ea8ed5-6bab-44a1-b4b9-db222855634d', '80e4086f-576f-46f5-b333-15248a89b3cb', '6767d099-988e-4131-ae49-6bba8c3a4781'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:42 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:08:42 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Acquiring lock "cinder-371e38f8-229f-4297-8afe-eda671600446-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Lock "cinder-371e38f8-229f-4297-8afe-eda671600446-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Acquiring lock "cinder-quobyte-371e38f8-229f-4297-8afe-eda671600446" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Lock "cinder-quobyte-371e38f8-229f-4297-8afe-eda671600446" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d561fd6d-db04-4a81-9729-471c4c2b6af1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:42 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 Apr 29 19:08:42 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:43 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.958s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:43 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:08:43 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Deleted volume successfully. Apr 29 19:08:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7e4860e7-3837-4d60-b604-fd6043ae62ec tempest-VolumesTestJSON-923050049 None] Lock "cinder-310f8d45-d479-46a7-b83f-94f8cf578625-delete_volume" released by "delete_volume" :: held 4.134s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:43 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446" returned: 0 in 0.774s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:43 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446 Apr 29 19:08:43 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:44 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-371e38f8-229f-4297-8afe-eda671600446" returned: 0 in 0.630s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Lock "cinder-quobyte-371e38f8-229f-4297-8afe-eda671600446" released by "delete_volume" :: held 1.457s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Created reservations ['65e42ce0-5a1a-4d30-95f5-7cc207693e1a', 'a05f7f71-98d7-4063-82f7-894803dd2bbb', 'bd59e833-adc4-44d1-a4fd-6d5a599e0834', 'fcee4f83-2c38-4aac-bf75-0109ba567f73'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:44 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:08:44 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:45 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.734s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:45 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:08:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Deleted volume successfully. Apr 29 19:08:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5751b0a5-6af9-4647-aaef-cf52c0d21925 tempest-VolumesTestJSON-923050049 None] Lock "cinder-371e38f8-229f-4297-8afe-eda671600446-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:08:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a006fecc-9362-41a9-abde-909f68636c4b tempest-BackendsCapabilitiesAdminTestsJSON-190747574 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5423545837402, 'free_capacity_gb': 1775.5423545837402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84523) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Apr 29 19:08:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d2a1b08-d7d0-481e-8e9b-2ccc5053dd4c tempest-BackendsCapabilitiesAdminTestsJSON-190747574 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5423545837402, 'free_capacity_gb': 1775.5423545837402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84523) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Apr 29 19:08:51 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:08:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Flow 'volume_create_manager' (d9bcf1c2-d3b8-4d54-8198-61e14e5e0cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff194eeb-9e7c-4874-ae4d-190d431006dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff194eeb-9e7c-4874-ae4d-190d431006dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:52Z,deleted=False,deleted_at=None,display_description='',display_name='bfbcb4d7-3180-496f-bc17-53a05b31bbd2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71158f3a-ebd2-4bae-b421-4cd7f5a22198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d40d3966834dc08fd58f48e6ca459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:52Z,use_quota=True,user_id='07726fc3ed6541549b34480de000fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25cc52d-a39c-45a8-bd6c-cb859e511a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25cc52d-a39c-45a8-bd6c-cb859e511a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b942227-a592-4ae1-8039-01276c3bc3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b942227-a592-4ae1-8039-01276c3bc3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71158f3a-ebd2-4bae-b421-4cd7f5a22198', 'volume_name': 'volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf35d67-185f-4ff4-80a2-4676f2f603a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf35d67-185f-4ff4-80a2-4676f2f603a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c704d646-0e84-40c4-b745-28cc07902d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:52 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Volume 71158f3a-ebd2-4bae-b421-4cd7f5a22198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198', 'volume_size': 1} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:08:52Z,deleted=False,deleted_at=None,display_description='',display_name='bfbcb4d7-3180-496f-bc17-53a05b31bbd2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71158f3a-ebd2-4bae-b421-4cd7f5a22198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d40d3966834dc08fd58f48e6ca459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:08:52Z,use_quota=True,user_id='07726fc3ed6541549b34480de000fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Creating volume 71158f3a-ebd2-4bae-b421-4cd7f5a22198 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:08:52 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:52 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 1073741824 Apr 29 19:08:52 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:52 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 1073741824" returned: 0 in 0.911s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:53 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 Apr 29 19:08:53 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:53 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198" returned: 0 in 0.703s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:08:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c704d646-0e84-40c4-b745-28cc07902d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd48c84-f004-4877-8ed7-fc48368c8f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:08:53 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Volume volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 (71158f3a-ebd2-4bae-b421-4cd7f5a22198): created successfully Apr 29 19:08:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd48c84-f004-4877-8ed7-fc48368c8f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:08:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Flow 'volume_create_manager' (d9bcf1c2-d3b8-4d54-8198-61e14e5e0cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:08:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-4d618878-9914-4c04-a3bc-a45ee33c3c77 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Created volume successfully. Apr 29 19:08:58 devstack cinder-volume[84523]: WARNING py.warnings [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-a9b0674b-51a7-4d00-9e96-baa9e0759f1a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 29 19:08:58 devstack cinder-volume[84523]: .first() Apr 29 19:08:58 devstack cinder-volume[84523]: Apr 29 19:08:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-a9b0674b-51a7-4d00-9e96-baa9e0759f1a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:08:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-a9b0674b-51a7-4d00-9e96-baa9e0759f1a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:08:58 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[194dd666-a53c-4f7f-b121-10eeda56b28c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:08:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-a9b0674b-51a7-4d00-9e96-baa9e0759f1a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:08:58 devstack sudo[85514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 Apr 29 19:08:58 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:08:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-13662aaa-2eb2-4866-b689-d932a64ee70c tempest-GroupSnapshotsV319Test-1115872712 None] Group tempest-GroupSnapshotsV319Test-Group-779651206: creating Apr 29 19:08:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-13662aaa-2eb2-4866-b689-d932a64ee70c tempest-GroupSnapshotsV319Test-1115872712 None] Group tempest-GroupSnapshotsV319Test-Group-779651206: created successfully Apr 29 19:08:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-13662aaa-2eb2-4866-b689-d932a64ee70c tempest-GroupSnapshotsV319Test-1115872712 None] Create group completed successfully. Apr 29 19:08:58 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root Apr 29 19:08:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-a9b0674b-51a7-4d00-9e96-baa9e0759f1a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198" returned: 0 in 0.887s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:08:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-a9b0674b-51a7-4d00-9e96-baa9e0759f1a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:08:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-a9b0674b-51a7-4d00-9e96-baa9e0759f1a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2', 'name': 'volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe7e0012-9a23-415f-899f-12fb405b83e9', 'enforce_multipath': True} {{(pid=84523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Apr 29 19:08:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-f280b4e0-69d2-46da-97d3-346b6cf2132c req-a9b0674b-51a7-4d00-9e96-baa9e0759f1a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] attachment_update completed successfully. Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Flow 'volume_create_manager' (b2d82882-e6fe-438f-bd29-5d5728b46f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a6ad23-fc43-4c6a-9162-1ee9e9060053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a6ad23-fc43-4c6a-9162-1ee9e9060053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2014826346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b499733b-4656-453e-97c6-c37ce41b6b48,host='devstack@QuobyteHD#QuobyteHD',id=d0e13dfd-9ca8-4781-b13c-9297e49f5589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4f78e8fbe84bd58254518e57178e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:00Z,use_quota=True,user_id='ee7c3b5eb5ba4d52bee49b7e5017aae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e97fe549-ede6-4510-af4c-5c445db20b87),volume_type_id=e97fe549-ede6-4510-af4c-5c445db20b87)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49d742f-c142-42c9-aa10-df35aa7fa621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49d742f-c142-42c9-aa10-df35aa7fa621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4578737-fa72-4625-b704-8f1791fe31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4578737-fa72-4625-b704-8f1791fe31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e13dfd-9ca8-4781-b13c-9297e49f5589', 'volume_name': 'volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95809fc-9c91-45f0-a3dd-cc187e69f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95809fc-9c91-45f0-a3dd-cc187e69f274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5dc4d0-8b5d-4928-99fc-57f575003c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:00 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Volume d0e13dfd-9ca8-4781-b13c-9297e49f5589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589', 'volume_size': 1} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b499733b-4656-453e-97c6-c37ce41b6b48,created_at=2026-04-29T17:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2014826346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b499733b-4656-453e-97c6-c37ce41b6b48,host='devstack@QuobyteHD#QuobyteHD',id=d0e13dfd-9ca8-4781-b13c-9297e49f5589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4f78e8fbe84bd58254518e57178e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:00Z,use_quota=True,user_id='ee7c3b5eb5ba4d52bee49b7e5017aae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e97fe549-ede6-4510-af4c-5c445db20b87),volume_type_id=e97fe549-ede6-4510-af4c-5c445db20b87)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Creating volume d0e13dfd-9ca8-4781-b13c-9297e49f5589 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:00 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:09:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:00 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 1073741824 Apr 29 19:09:00 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:01 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 1073741824" returned: 0 in 0.916s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:01 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 Apr 29 19:09:01 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:02 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589" returned: 0 in 0.902s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:09:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5dc4d0-8b5d-4928-99fc-57f575003c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c496e753-e134-42b7-9e78-e8d04a5b6adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:02 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Volume volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 (d0e13dfd-9ca8-4781-b13c-9297e49f5589): created successfully Apr 29 19:09:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c496e753-e134-42b7-9e78-e8d04a5b6adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Flow 'volume_create_manager' (b2d82882-e6fe-438f-bd29-5d5728b46f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:02 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-212fe31b-8a00-46a9-9440-1d43088b3afc tempest-GroupSnapshotsV319Test-1115872712 None] Created volume successfully. Apr 29 19:09:02 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] GroupSnapshot 2ba8b9df-5c80-4b73-9cee-28be64fe591d: creating. Apr 29 19:09:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Group snapshot 2ba8b9df-5c80-4b73-9cee-28be64fe591d: creating. {{(pid=84523) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Apr 29 19:09:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Creating offline snapshot e37ba21d-18b5-4813-bcde-97d008175998 of volume d0e13dfd-9ca8-4781-b13c-9297e49f5589 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:09:03 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d798419-bff0-47d4-935e-ee71b930cbd9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:03 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 Apr 29 19:09:03 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:03 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589" returned: 0 in 0.742s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:03 devstack sudo[85607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 1G Apr 29 19:09:03 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:04 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 1G" returned: 0 in 1.025s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:04 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 Apr 29 19:09:04 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:05 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998" returned: 0 in 1.046s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:05 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:09:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:05 devstack sudo[85966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 Apr 29 19:09:05 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:06 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998" returned: 0 in 0.888s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:06 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.info Apr 29 19:09:06 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0047ba4e-95b7-4186-a2be-4252a2ee6cea tempest-GroupsV314Test-1950506923 None] Group tempest-GroupsV314Test-Group-2070325556: creating Apr 29 19:09:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0047ba4e-95b7-4186-a2be-4252a2ee6cea tempest-GroupsV314Test-1950506923 None] Group tempest-GroupsV314Test-Group-2070325556: created successfully Apr 29 19:09:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0047ba4e-95b7-4186-a2be-4252a2ee6cea tempest-GroupsV314Test-1950506923 None] Create group completed successfully. Apr 29 19:09:07 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.info" returned: 0 in 0.904s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:07 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:09:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:07 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.info Apr 29 19:09:07 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:08 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.info" returned: 0 in 0.658s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.386s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:08 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-284c28ab-67b2-4da6-88e7-88ee1e7e02e8 tempest-GroupSnapshotsV319Test-1115872712 None] group_snapshot 2ba8b9df-5c80-4b73-9cee-28be64fe591d: created successfully Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Flow 'volume_create_manager' (33c3b123-c820-458f-a71b-1bc34bd6183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2930a868-2b90-4fe7-9da3-03a3e34ebd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2930a868-2b90-4fe7-9da3-03a3e34ebd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1886641986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40028ea1-b6d0-4888-9211-a3bead930dcd,host='devstack@QuobyteHD#QuobyteHD',id=67f7d258-43f2-4832-a4fc-105fb7af9b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e130c0fc264f7cbe81d91940620f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:09Z,use_quota=True,user_id='0e0fab07435c4677a76194bb930f17bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30f9488a-3584-46c3-8f9f-7008746f68f4),volume_type_id=30f9488a-3584-46c3-8f9f-7008746f68f4)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef6cf1d-ecab-4f7c-ae7f-8344d19738d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef6cf1d-ecab-4f7c-ae7f-8344d19738d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b64ee6-5ee0-4a78-b439-4a155745945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b64ee6-5ee0-4a78-b439-4a155745945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f7d258-43f2-4832-a4fc-105fb7af9b55', 'volume_name': 'volume-67f7d258-43f2-4832-a4fc-105fb7af9b55', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbecf6b9-ccc7-4a9c-aaff-475210ce7641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbecf6b9-ccc7-4a9c-aaff-475210ce7641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bd3a1a-0c6a-4bca-8880-6ccc4e64883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:08 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Volume 67f7d258-43f2-4832-a4fc-105fb7af9b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f7d258-43f2-4832-a4fc-105fb7af9b55', 'volume_size': 1} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=40028ea1-b6d0-4888-9211-a3bead930dcd,created_at=2026-04-29T17:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1886641986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40028ea1-b6d0-4888-9211-a3bead930dcd,host='devstack@QuobyteHD#QuobyteHD',id=67f7d258-43f2-4832-a4fc-105fb7af9b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e130c0fc264f7cbe81d91940620f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:09Z,use_quota=True,user_id='0e0fab07435c4677a76194bb930f17bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30f9488a-3584-46c3-8f9f-7008746f68f4),volume_type_id=30f9488a-3584-46c3-8f9f-7008746f68f4)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Creating volume 67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:08 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:09:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:08 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 1073741824 Apr 29 19:09:08 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:09 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 1073741824" returned: 0 in 1.075s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:09 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=58,cinder:SELECT=54,cinder:INSERT=9,cinder:DELETE=1 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:09:09 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=41,cinder:INSERT=14,cinder:UPDATE=55,cinder:DELETE=9 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:09:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:09 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 Apr 29 19:09:09 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] group_snapshot 2ba8b9df-5c80-4b73-9cee-28be64fe591d: deleting Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] group_snapshot 2ba8b9df-5c80-4b73-9cee-28be64fe591d: deleting {{(pid=84523) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Acquiring lock "cinder-quobyte-d0e13dfd-9ca8-4781-b13c-9297e49f5589" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Lock "cinder-quobyte-d0e13dfd-9ca8-4781-b13c-9297e49f5589" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Acquiring lock "cinder-quobyte-e37ba21d-18b5-4813-bcde-97d008175998" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Lock "cinder-quobyte-e37ba21d-18b5-4813-bcde-97d008175998" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Deleting offline snapshot e37ba21d-18b5-4813-bcde-97d008175998 of volume d0e13dfd-9ca8-4781-b13c-9297e49f5589 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] snapshot_file for this snap is: volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422dfc7-c445-4106-bb59-c5ad0eeb35b6]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:10 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 Apr 29 19:09:10 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:10 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55" returned: 0 in 0.787s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bd3a1a-0c6a-4bca-8880-6ccc4e64883d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f7d258-43f2-4832-a4fc-105fb7af9b55', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845f3591-10af-43a3-a9eb-b5cd77f4ced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:10 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Volume volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 (67f7d258-43f2-4832-a4fc-105fb7af9b55): created successfully Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845f3591-10af-43a3-a9eb-b5cd77f4ced2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Flow 'volume_create_manager' (33c3b123-c820-458f-a71b-1bc34bd6183a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-51300a2f-c937-4654-b7e9-32a03e12425c tempest-GroupsV314Test-1950506923 None] Created volume successfully. Apr 29 19:09:11 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998" returned: 0 in 0.900s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:09:11 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7e0cf8-631d-4c8f-b70f-9fdaf2353d00]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:11 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 Apr 29 19:09:11 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:12 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589" returned: 0 in 0.927s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:12 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 Apr 29 19:09:12 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:12 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Cloning volume 67f7d258-43f2-4832-a4fc-105fb7af9b55 to volume ed07a03c-b4a9-4c54-87bf-773793dfa9d0 Apr 29 19:09:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Creating offline snapshot f20c7607-3852-4d2e-93dd-ead3918ed746 of volume 67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:09:12 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc408750-fd1f-4772-8ebc-22b1a87776b1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:12 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 Apr 29 19:09:12 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:13 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998" returned: 0 in 0.952s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:13 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998 Apr 29 19:09:13 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:13 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55" returned: 0 in 0.861s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:13 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 1G Apr 29 19:09:13 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:14 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589.e37ba21d-18b5-4813-bcde-97d008175998" returned: 0 in 1.010s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Lock "cinder-quobyte-e37ba21d-18b5-4813-bcde-97d008175998" released by "_delete_snapshot" :: held 3.924s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Lock "cinder-quobyte-d0e13dfd-9ca8-4781-b13c-9297e49f5589" released by "delete_snapshot" :: held 3.971s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:14 devstack cinder-volume[84523]: WARNING cinder.quota [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1711346400 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1711346400, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:09:14 devstack cinder-volume[84523]: WARNING cinder.quota [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1711346400 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1711346400, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:09:14 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] Created reservations ['558b3cc1-7698-4aa6-8c00-82574b006c5d', 'ad9fd873-8051-4774-80b8-810900db2497', '2abbce57-7009-4324-8e9e-82f5d80274e2', 'd7f7a88d-9368-4941-9880-8468412ea503'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:14 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 1G" returned: 0 in 1.224s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:14 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 Apr 29 19:09:14 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:14 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9c4ba586-69ba-404d-8343-56b2a287813b tempest-GroupSnapshotsV319Test-1115872712 None] group_snapshot 2ba8b9df-5c80-4b73-9cee-28be64fe591d: deleted successfully Apr 29 19:09:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Acquiring lock "cinder-quobyte-d0e13dfd-9ca8-4781-b13c-9297e49f5589" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Lock "cinder-quobyte-d0e13dfd-9ca8-4781-b13c-9297e49f5589" acquired by "delete_volume" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:15 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ef4acd-ad9f-49d7-b449-f53d1e0b13c4]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:15 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 Apr 29 19:09:15 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:15 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746" returned: 0 in 0.857s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:15 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:09:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:15 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 Apr 29 19:09:15 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:16 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589" returned: 0 in 1.220s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:16 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589 Apr 29 19:09:16 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:16 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746" returned: 0 in 1.116s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:16 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.info Apr 29 19:09:16 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:17 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.info" returned: 0 in 0.862s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:17 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:09:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:17 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.info Apr 29 19:09:17 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:17 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d0e13dfd-9ca8-4781-b13c-9297e49f5589" returned: 0 in 1.302s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:17 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Lock "cinder-quobyte-d0e13dfd-9ca8-4781-b13c-9297e49f5589" released by "delete_volume" :: held 2.633s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:17 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Created reservations ['0a896a97-add2-4152-856d-c746656fe60c'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:17 devstack cinder-volume[84523]: WARNING cinder.quota [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1711346400 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1711346400, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:09:17 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Created reservations ['e2e4022e-f3f9-44d0-be32-e61618a6dbfa', '980e5c96-575f-45ee-997c-48c386bc3722', 'd83d7925-4c8e-4efe-ac7b-b672d5bc6d14', '07a67e2b-659a-4494-a3d8-3449b9f210ff'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:18 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.info" returned: 0 in 0.779s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:18 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:09:18 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Acquiring lock "cinder-quobyte-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Lock "cinder-quobyte-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] snapshot: f20c7607-3852-4d2e-93dd-ead3918ed746, volume: ed07a03c-b4a9-4c54-87bf-773793dfa9d0, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3737bb4b-69a2-4db7-96a3-2311ee7b1fdc]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:18 devstack sudo[86094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 Apr 29 19:09:18 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:19 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.132s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:19 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:09:19 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0e5cf5fb-3c02-48de-bcc6-2cc46b4a4473 tempest-GroupSnapshotsV319Test-1115872712 None] Delete group completed successfully. Apr 29 19:09:19 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746" returned: 0 in 1.243s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67f7d258-43f2-4832-a4fc-105fb7af9b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:09:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:09:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:09:19 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a07a6b-70e8-4b71-a066-752a34341f17]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:19 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 Apr 29 19:09:19 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:20 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55" returned: 0 in 1.239s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:20 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:09:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:20 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 Apr 29 19:09:20 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:29 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" returned: 0 in 8.925s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[003472a8-f60d-4c95-85c6-1fdc2835aa3e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:09:29 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=20,cinder:UPDATE=17,cinder:INSERT=5 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:09:29 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:09:29 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:29 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 Apr 29 19:09:29 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:30 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.988s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:09:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:09:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 8 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:09:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:09:31 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55" returned: 0 in 1.469s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:31 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:09:31 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Converted 1024.00 MB image at 114.69 MB/s Apr 29 19:09:31 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:09:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:31 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 Apr 29 19:09:31 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:32 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" returned: 0 in 1.006s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Lock "cinder-quobyte-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" released by "_copy_volume_from_snapshot" :: held 14.039s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Acquiring lock "cinder-quobyte-f20c7607-3852-4d2e-93dd-ead3918ed746" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Lock "cinder-quobyte-f20c7607-3852-4d2e-93dd-ead3918ed746" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Deleting offline snapshot f20c7607-3852-4d2e-93dd-ead3918ed746 of volume 67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:09:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] snapshot_file for this snap is: volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:09:32 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb645574-2a02-4cb0-bcc2-968889117818]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:32 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 Apr 29 19:09:32 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:33 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746" returned: 0 in 1.617s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67f7d258-43f2-4832-a4fc-105fb7af9b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:09:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[70249e51-0fd2-4fbd-98e0-8f80788fa42e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:34 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 Apr 29 19:09:34 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:35 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55" returned: 0 in 1.046s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:35 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 Apr 29 19:09:35 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:35 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746" returned: 0 in 0.899s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:35 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746 Apr 29 19:09:35 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:36 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55.f20c7607-3852-4d2e-93dd-ead3918ed746" returned: 0 in 0.668s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Lock "cinder-quobyte-f20c7607-3852-4d2e-93dd-ead3918ed746" released by "_delete_snapshot" :: held 4.401s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.409s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2c293e50-1e7b-42bc-99b7-c9f6a22c079f tempest-GroupsV314Test-1950506923 None] Create group from source-group-40028ea1-b6d0-4888-9211-a3bead930dcd completed successfully. Apr 29 19:09:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Acquiring lock "cinder-quobyte-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Lock "cinder-quobyte-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:37 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fa411e-3853-44e2-96c5-05c98e1394a1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:37 devstack sudo[86329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 Apr 29 19:09:37 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:38 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" returned: 0 in 0.825s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:38 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0 Apr 29 19:09:38 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:38 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" returned: 0 in 0.695s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Lock "cinder-quobyte-ed07a03c-b4a9-4c54-87bf-773793dfa9d0" released by "delete_volume" :: held 1.579s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:38 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Created reservations ['23dc12ae-746b-42f6-8e15-b6194d68a4d5'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:38 devstack cinder-volume[84523]: WARNING cinder.quota [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1258350430 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1258350430, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:09:38 devstack cinder-volume[84523]: WARNING cinder.quota [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1258350430 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1258350430, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:09:38 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Created reservations ['cf504426-fd63-4bce-a9da-68cb4c20c29d', 'a09e4fec-a394-4aad-b25f-ceecf6d221db', '863dfc4a-658b-4705-a370-4675729efa28', 'af5ce562-7d2d-44ac-b620-b60e958ae9ad'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:39 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:09:39 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:39 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.646s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:09:39 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4bb95dee-dd98-4357-913d-b206cc809dff tempest-GroupsV314Test-1950506923 None] Delete group completed successfully. Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Acquiring lock "cinder-quobyte-67f7d258-43f2-4832-a4fc-105fb7af9b55" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Lock "cinder-quobyte-67f7d258-43f2-4832-a4fc-105fb7af9b55" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae0c5c6-6eff-49db-ac80-7f6c62a53080]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:40 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 Apr 29 19:09:40 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:41 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55" returned: 0 in 1.777s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:41 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55 Apr 29 19:09:41 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Flow 'volume_create_manager' (a5a537b7-ae43-4605-87b1-f81a406d8883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeed019-09cd-4204-b212-49f085ff893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeed019-09cd-4204-b212-49f085ff893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1454398937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a694d35b-6baf-4e17-96ec-871d773f87e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2025503d8c2f4e5285b4710564a4b38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:42Z,use_quota=True,user_id='481fd3c465fd4faab665cec7012226bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0aa567-d018-47c7-b0c6-126312625e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0aa567-d018-47c7-b0c6-126312625e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bedc890-4f4e-4264-809b-71764331fdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bedc890-4f4e-4264-809b-71764331fdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a694d35b-6baf-4e17-96ec-871d773f87e0', 'volume_name': 'volume-a694d35b-6baf-4e17-96ec-871d773f87e0', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1fb43b-5327-493b-b734-deaec539d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1fb43b-5327-493b-b734-deaec539d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5e2a79-c93b-45c4-a205-bb5b96c23360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:42 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Volume a694d35b-6baf-4e17-96ec-871d773f87e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a694d35b-6baf-4e17-96ec-871d773f87e0', 'volume_size': 1} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1454398937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a694d35b-6baf-4e17-96ec-871d773f87e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2025503d8c2f4e5285b4710564a4b38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:42Z,use_quota=True,user_id='481fd3c465fd4faab665cec7012226bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Creating volume a694d35b-6baf-4e17-96ec-871d773f87e0 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:42 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:42 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 1073741824 Apr 29 19:09:42 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:42 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67f7d258-43f2-4832-a4fc-105fb7af9b55" returned: 0 in 1.229s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Lock "cinder-quobyte-67f7d258-43f2-4832-a4fc-105fb7af9b55" released by "delete_volume" :: held 3.191s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Created reservations ['27ad04e9-8eb1-4a77-8ce5-80eeaeddefbc'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Created reservations ['2e24213d-202f-4832-811e-c0996d4be67d', 'becc4494-e56b-489b-9503-f3cb016f5fb9', '3bda90c8-153c-48b2-bcb5-0e05cc58e91b', '99a1c757-10b0-4bf7-bb2b-baccb7b3ce6b'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:43 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:09:43 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:44 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 1073741824" returned: 0 in 1.935s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:44 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 Apr 29 19:09:44 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:44 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.923s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:44 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:09:44 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1125dda2-6aac-4e4c-bb19-ea0bd432465a tempest-GroupsV314Test-1950506923 None] Delete group completed successfully. Apr 29 19:09:45 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0" returned: 0 in 1.152s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] <== create_volume: return (3214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.219s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Flow 'volume_create_manager' (fd2038e3-6d6e-49f5-b524-4ec8708363a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db15ea49-54b9-48c5-9ec5-450f2fbec01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db15ea49-54b9-48c5-9ec5-450f2fbec01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2110545581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df58af841d447e6a907ae604c29eab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:45Z,use_quota=True,user_id='ef20be6b01c442e48750118ba49cfd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fa22b9-56f5-4dcf-a491-8d891e0e1fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fa22b9-56f5-4dcf-a491-8d891e0e1fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fd72c6-d0e9-4fb9-a159-70a8a891cc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fd72c6-d0e9-4fb9-a159-70a8a891cc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7', 'volume_name': 'volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70844b74-46a8-4a5d-9db7-4e4f64d10289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70844b74-46a8-4a5d-9db7-4e4f64d10289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8d73db-5392-4383-8cf9-5f678e86acae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Volume 6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7', 'volume_size': 1} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2110545581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df58af841d447e6a907ae604c29eab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:45Z,use_quota=True,user_id='ef20be6b01c442e48750118ba49cfd79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Creating volume 6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:45 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5e2a79-c93b-45c4-a205-bb5b96c23360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a694d35b-6baf-4e17-96ec-871d773f87e0', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed494b7-cfc4-41e5-bc99-78eabf44fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:45 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 1073741824 Apr 29 19:09:45 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Volume volume-a694d35b-6baf-4e17-96ec-871d773f87e0 (a694d35b-6baf-4e17-96ec-871d773f87e0): created successfully Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed494b7-cfc4-41e5-bc99-78eabf44fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Flow 'volume_create_manager' (a5a537b7-ae43-4605-87b1-f81a406d8883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-aef242c3-4ef6-403f-8dc1-e8f79b402157 tempest-VolumeQuotasAdminTestJSON-267633855 None] Created volume successfully. Apr 29 19:09:46 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 1073741824" returned: 0 in 1.030s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:46 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 Apr 29 19:09:46 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Acquiring lock "cinder-a694d35b-6baf-4e17-96ec-871d773f87e0-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "cinder-a694d35b-6baf-4e17-96ec-871d773f87e0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Acquiring lock "cinder-quobyte-a694d35b-6baf-4e17-96ec-871d773f87e0" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "cinder-quobyte-a694d35b-6baf-4e17-96ec-871d773f87e0" acquired by "delete_volume" :: waited 0.046s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:47 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fd673c-5791-40fa-8734-d6d00c6c9424]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:47 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 Apr 29 19:09:47 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:47 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7" returned: 0 in 1.317s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] <== create_volume: return (2400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:09:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.403s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8d73db-5392-4383-8cf9-5f678e86acae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b726bfef-dbaa-4608-9237-5f2440d21a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:48 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Volume volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 (6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7): created successfully Apr 29 19:09:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b726bfef-dbaa-4608-9237-5f2440d21a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Flow 'volume_create_manager' (fd2038e3-6d6e-49f5-b524-4ec8708363a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:48 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-14e92ef9-1796-4397-b593-4c4ea36882d1 tempest-DeleteServersTestJSON-71407196 None] Created volume successfully. Apr 29 19:09:48 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0" returned: 0 in 1.112s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:48 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0 Apr 29 19:09:48 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:48 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a694d35b-6baf-4e17-96ec-871d773f87e0" returned: 0 in 0.782s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "cinder-quobyte-a694d35b-6baf-4e17-96ec-871d773f87e0" released by "delete_volume" :: held 1.967s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:49 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Created reservations ['0d536e2e-29c8-4e71-ac9e-76e260c27b03', '7b9bfda1-d2ae-4d79-b266-1c7aa17fe98f', '86456ffc-4bdc-403d-8576-1f25ea2e62ef', '25627eef-09e5-4f67-8016-bab057f116c4'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:49 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:09:49 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Flow 'volume_create_manager' (57632aa7-0a18-43ee-acab-5c76322d9c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b8f8b1-aa5d-44a8-be49-4d0844d27dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b8f8b1-aa5d-44a8-be49-4d0844d27dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1883985298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b22c314-779a-4573-b1c6-365d16271753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2025503d8c2f4e5285b4710564a4b38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:50Z,use_quota=True,user_id='481fd3c465fd4faab665cec7012226bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb40453-b137-4304-b51f-be5584d66f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb40453-b137-4304-b51f-be5584d66f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6282be7-368f-4583-9747-762d62a89a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6282be7-368f-4583-9747-762d62a89a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b22c314-779a-4573-b1c6-365d16271753', 'volume_name': 'volume-3b22c314-779a-4573-b1c6-365d16271753', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99903266-6366-4bf5-9dfe-034c26c596aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99903266-6366-4bf5-9dfe-034c26c596aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc70def4-b817-4ab9-bf69-04e3878ed147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:50 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Volume 3b22c314-779a-4573-b1c6-365d16271753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b22c314-779a-4573-b1c6-365d16271753', 'volume_size': 1} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1883985298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b22c314-779a-4573-b1c6-365d16271753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2025503d8c2f4e5285b4710564a4b38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:09:50Z,use_quota=True,user_id='481fd3c465fd4faab665cec7012226bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Creating volume 3b22c314-779a-4573-b1c6-365d16271753 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:09:50 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:50 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 1073741824 Apr 29 19:09:50 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:50 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.123s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:09:50 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Deleted volume successfully. Apr 29 19:09:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98a1d773-a6e0-4be4-afd5-ac799273864b tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "cinder-a694d35b-6baf-4e17-96ec-871d773f87e0-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:51 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 1073741824" returned: 0 in 1.163s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:51 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 Apr 29 19:09:51 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:52 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753" returned: 0 in 1.137s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] <== create_volume: return (2408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:09:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.411s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc70def4-b817-4ab9-bf69-04e3878ed147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b22c314-779a-4573-b1c6-365d16271753', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8922813a-8417-4d36-beb6-2f15b465f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:09:52 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Volume volume-3b22c314-779a-4573-b1c6-365d16271753 (3b22c314-779a-4573-b1c6-365d16271753): created successfully Apr 29 19:09:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8922813a-8417-4d36-beb6-2f15b465f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:09:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Flow 'volume_create_manager' (57632aa7-0a18-43ee-acab-5c76322d9c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:09:52 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c1219234-b91a-498e-ad70-3068886d49d2 tempest-VolumeQuotasAdminTestJSON-267633855 None] Created volume successfully. Apr 29 19:09:52 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f214b060-76cb-499b-bdea-4455400affe7 tempest-GroupsV320Test-487119116 None] Group tempest-GroupsV320Test-Group-2085153517: creating Apr 29 19:09:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f214b060-76cb-499b-bdea-4455400affe7 tempest-GroupsV320Test-487119116 None] Group tempest-GroupsV320Test-Group-2085153517: created successfully Apr 29 19:09:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f214b060-76cb-499b-bdea-4455400affe7 tempest-GroupsV320Test-487119116 None] Create group completed successfully. Apr 29 19:09:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-b62bc5f7-16ef-4567-95ed-eab65829375c req-1a674968-ac52-4891-9c7b-7229fadab61d tempest-DeleteServersTestJSON-71407196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-b62bc5f7-16ef-4567-95ed-eab65829375c req-1a674968-ac52-4891-9c7b-7229fadab61d tempest-DeleteServersTestJSON-71407196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:53 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8283413-25d7-4a54-bff0-f51478157c8d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-b62bc5f7-16ef-4567-95ed-eab65829375c req-1a674968-ac52-4891-9c7b-7229fadab61d tempest-DeleteServersTestJSON-71407196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:53 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 Apr 29 19:09:53 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-194f6df9-281f-4c69-9d41-dc4e710961f2 tempest-VolumeQuotasAdminTestJSON-1829960556 None] Transfer volume completed successfully. Apr 29 19:09:54 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-b62bc5f7-16ef-4567-95ed-eab65829375c req-1a674968-ac52-4891-9c7b-7229fadab61d tempest-DeleteServersTestJSON-71407196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7" returned: 0 in 1.208s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-b62bc5f7-16ef-4567-95ed-eab65829375c req-1a674968-ac52-4891-9c7b-7229fadab61d tempest-DeleteServersTestJSON-71407196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.225s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-b62bc5f7-16ef-4567-95ed-eab65829375c req-1a674968-ac52-4891-9c7b-7229fadab61d tempest-DeleteServersTestJSON-71407196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2', 'name': 'volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa3c4397-235b-4d7d-b03e-77ee11d94919', 'enforce_multipath': True} {{(pid=84523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Apr 29 19:09:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-b62bc5f7-16ef-4567-95ed-eab65829375c req-1a674968-ac52-4891-9c7b-7229fadab61d tempest-DeleteServersTestJSON-71407196 None] attachment_update completed successfully. Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Acquiring lock "cinder-3b22c314-779a-4573-b1c6-365d16271753-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Lock "cinder-3b22c314-779a-4573-b1c6-365d16271753-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Acquiring lock "cinder-quobyte-3b22c314-779a-4573-b1c6-365d16271753" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Lock "cinder-quobyte-3b22c314-779a-4573-b1c6-365d16271753" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d96b44-46a2-4f3a-8ced-cc8b8fae39cf]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Created reservations ['0581f211-7e7d-428c-9d05-22e42f085488'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:55 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 Apr 29 19:09:55 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:55 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:09:55 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:56 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753" returned: 0 in 1.060s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:56 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753 Apr 29 19:09:56 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:56 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.881s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:56 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:09:56 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-dae7f328-9eb1-4fa6-af54-f654cea3b095 tempest-GroupsV320Test-487119116 None] Delete group completed successfully. Apr 29 19:09:57 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3b22c314-779a-4573-b1c6-365d16271753" returned: 0 in 0.780s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Lock "cinder-quobyte-3b22c314-779a-4573-b1c6-365d16271753" released by "delete_volume" :: held 1.905s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Created reservations ['eb3a24b8-4d8e-48d9-aa48-1d23f0024973', '8b43a01c-fda0-4d8c-a865-efad24b5b9ec', '040d779b-7a30-43a6-9d4f-a2003f0b6af0', '21c34833-bcb1-421d-943f-3751ec63897a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:09:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:09:57 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:09:57 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:09:58 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 29 19:09:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.965s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:09:58 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:09:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Deleted volume successfully. Apr 29 19:09:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-45f9e43d-258a-4b88-a121-3c694204cf2e tempest-VolumeQuotasAdminTestJSON-241466019 None] Lock "cinder-3b22c314-779a-4573-b1c6-365d16271753-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:05 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-f7db2abf-cd15-46f6-afa1-f83488e8bb77 req-58ce9f48-50bb-4417-9a38-738248364f87 tempest-DeleteServersTestJSON-71407196 None] Terminate volume connection completed successfully. Apr 29 19:10:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-f7db2abf-cd15-46f6-afa1-f83488e8bb77 req-58ce9f48-50bb-4417-9a38-738248364f87 tempest-DeleteServersTestJSON-71407196 None] Deleting attachment fa3c4397-235b-4d7d-b03e-77ee11d94919. {{(pid=84523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Apr 29 19:10:08 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=62,cinder:SELECT=51,cinder:INSERT=10,cinder:DELETE=3 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:10:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Acquiring lock "cinder-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Lock "cinder-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Acquiring lock "cinder-quobyte-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Lock "cinder-quobyte-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7" acquired by "delete_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:09 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e40b855-b695-4473-b38b-de1187dee175]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:09 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 Apr 29 19:10:09 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:10 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7" returned: 0 in 1.044s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:10 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7 Apr 29 19:10:10 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:11 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7" returned: 0 in 0.733s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Lock "cinder-quobyte-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7" released by "delete_volume" :: held 1.850s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Created reservations ['b7596c46-051a-47e2-84b6-aa973b123879', 'f9c9c25b-1e7c-4e68-bee3-9930bd6f1706', 'e245c15a-b00c-4491-934a-0eecf046a37a', '884c0edd-3a94-4fd8-bf0c-b62bd5b51794'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:11 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:10:11 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:12 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.825s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:12 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:10:12 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Deleted volume successfully. Apr 29 19:10:12 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f57b0f93-2349-4107-8f7c-bc59ddbcbc20 tempest-DeleteServersTestJSON-71407196 None] Lock "cinder-6afa3e47-93dc-4c6d-9e0a-4f27a4b895c7-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:17 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:10:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Flow 'volume_create_manager' (cdfb464b-25d3-4036-a9cb-743b1625b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6beeef97-3248-4fc4-a618-d79d9007dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6beeef97-3248-4fc4-a618-d79d9007dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:17Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631cad3b-e53b-48c7-b3fc-11195a1e9030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d40d3966834dc08fd58f48e6ca459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:18Z,use_quota=True,user_id='07726fc3ed6541549b34480de000fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e9379b-2182-4aa8-9f8c-7020e8b29ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e9379b-2182-4aa8-9f8c-7020e8b29ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de7aa90-e925-4a28-ab5e-a884e5e491fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:17 devstack cinder-volume[84523]: DEBUG cinder.image.glance [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Creating Keystone auth plugin from conf {{(pid=84523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 19:10:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de7aa90-e925-4a28-ab5e-a884e5e491fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '631cad3b-e53b-48c7-b3fc-11195a1e9030', 'volume_name': 'volume-631cad3b-e53b-48c7-b3fc-11195a1e9030', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501f1fad-7a16-4dc6-88fb-441df5cd4210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501f1fad-7a16-4dc6-88fb-441df5cd4210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8a0353-2439-4f08-816e-243bea680451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:19 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Volume 631cad3b-e53b-48c7-b3fc-11195a1e9030: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-631cad3b-e53b-48c7-b3fc-11195a1e9030', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 19:10:19 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Trying to clone 631cad3b-e53b-48c7-b3fc-11195a1e9030 from image f7bc816f-25b0-408e-baa1-85adebe218d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]). {{(pid=84523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 19:10:20 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 19:10:20 devstack cinder-volume[84523]: INFO cinder.image.image_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Image download 20.69 MB at 20.69 MB/s Apr 29 19:10:20 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e831d7a-6c5e-4538-bafd-912b074c62b8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:20 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD Apr 29 19:10:20 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:21 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:21 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Temporary image f7bc816f-25b0-408e-baa1-85adebe218d0 is fetched for user 07726fc3ed6541549b34480de000fe73. {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 19:10:21 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[62894bad-8db7-4ef8-ac96-1dae0846308c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:21 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD Apr 29 19:10:21 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:22 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD" returned: 0 in 0.937s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:17Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631cad3b-e53b-48c7-b3fc-11195a1e9030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d40d3966834dc08fd58f48e6ca459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:18Z,use_quota=True,user_id='07726fc3ed6541549b34480de000fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Creating volume 631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:22 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:10:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:22 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 1073741824 Apr 29 19:10:22 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:23 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 1073741824" returned: 0 in 1.035s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:23 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:10:23 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:24 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 0 in 0.994s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:10:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:24 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Attempting download of f7bc816f-25b0-408e-baa1-85adebe218d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}])) to volume 631cad3b-e53b-48c7-b3fc-11195a1e9030. {{(pid=84523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 29 19:10:24 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e7f41f-3fda-4c55-9c56-1b6222e9c0f9]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_rym_sekg {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:24 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_rym_sekg Apr 29 19:10:24 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:25 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_rym_sekg" returned: 0 in 0.983s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_rym_sekg {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Flow 'volume_create_manager' (f80ad7bb-d9f1-430a-a7f5-5bba88ad5c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46ebe94-23a0-40de-8f07-9bf2cbf57027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46ebe94-23a0-40de-8f07-9bf2cbf57027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-46281354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d5aaaa-716b-46d5-b51b-a14dd8e2414b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823fb5f9c467403e8b588b10ce946216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:25Z,use_quota=True,user_id='01e0bb59d6564d7ea39cd7db440b911a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e79c21-b337-45b4-92d2-33739613e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e79c21-b337-45b4-92d2-33739613e26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556042da-64f8-4952-a45d-cc6c043cba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556042da-64f8-4952-a45d-cc6c043cba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d5aaaa-716b-46d5-b51b-a14dd8e2414b', 'volume_name': 'volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb65fc4-6a62-4111-9cc5-a6d55ee41d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:25 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_rym_sekg Apr 29 19:10:25 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb65fc4-6a62-4111-9cc5-a6d55ee41d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f1b5f3-7b7e-4a93-a103-e744aba9c793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:25 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Volume 25d5aaaa-716b-46d5-b51b-a14dd8e2414b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b', 'volume_size': 1} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-46281354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d5aaaa-716b-46d5-b51b-a14dd8e2414b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823fb5f9c467403e8b588b10ce946216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:25Z,use_quota=True,user_id='01e0bb59d6564d7ea39cd7db440b911a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Creating volume 25d5aaaa-716b-46d5-b51b-a14dd8e2414b {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:25 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:10:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:25 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b 1073741824 Apr 29 19:10:25 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:26 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_rym_sekg" returned: 1 in 1.106s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_rym_sekg' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:10:26 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[881bce6d-d09f-4b91-ba39-e6abdec23bd6]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:26 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD Apr 29 19:10:26 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:26 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b 1073741824" returned: 0 in 1.218s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:26 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b Apr 29 19:10:26 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:27 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD" returned: 0 in 1.022s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] f7bc816f-25b0-408e-baa1-85adebe218d0 was qcow2, converting to raw {{(pid=84523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:27 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:10:27 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:27 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b" returned: 0 in 0.835s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] <== create_volume: return (2150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f1b5f3-7b7e-4a93-a103-e744aba9c793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea9f720-b1f7-4e76-b1f4-9d96e6d6f142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:27 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Volume volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b (25d5aaaa-716b-46d5-b51b-a14dd8e2414b): created successfully Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea9f720-b1f7-4e76-b1f4-9d96e6d6f142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Flow 'volume_create_manager' (f80ad7bb-d9f1-430a-a7f5-5bba88ad5c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:27 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7744de7d-c364-43b1-b998-7b35117d108a tempest-AbsoluteLimitsTests-1691297929 None] Created volume successfully. Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Acquiring lock "cinder-25d5aaaa-716b-46d5-b51b-a14dd8e2414b-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Lock "cinder-25d5aaaa-716b-46d5-b51b-a14dd8e2414b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Acquiring lock "cinder-quobyte-25d5aaaa-716b-46d5-b51b-a14dd8e2414b" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Lock "cinder-quobyte-25d5aaaa-716b-46d5-b51b-a14dd8e2414b" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cc4062-5d8b-4794-ad04-a872febd83c3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:29 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b Apr 29 19:10:29 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:29 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:10:29 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:30 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 0 in 2.512s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:30 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_myqoyehudevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:10:30 devstack cinder-volume[84523]: INFO cinder.image.image_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Converted 112.00 MB image at 44.56 MB/s Apr 29 19:10:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:30 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 1G Apr 29 19:10:30 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:30 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b" returned: 0 in 1.130s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:30 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b Apr 29 19:10:30 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:30 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.962s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:10:31 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 1G" returned: 0 in 1.040s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde6104-1e39-44b1-9ed9-728fe61c998c]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:31 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-25d5aaaa-716b-46d5-b51b-a14dd8e2414b" returned: 0 in 0.840s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Lock "cinder-quobyte-25d5aaaa-716b-46d5-b51b-a14dd8e2414b" released by "delete_volume" :: held 2.040s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=57,cinder:SELECT=64,cinder:INSERT=14,cinder:DELETE=4 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Created reservations ['7469f03d-5985-441e-8f6c-a040767095a4', 'c027fc75-0d44-45a3-aac2-45a0f0290025', '40d8d4c8-47ed-434c-84c3-c5869d5caebe', 'e68a751b-80ad-4a3b-9cb1-79ec41a4fdfe'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:31 devstack sudo[86848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:10:31 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:31 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:10:31 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:32 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 0 in 0.935s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:32 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.723s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:32 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:10:32 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Deleted volume successfully. Apr 29 19:10:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb0ef44a-7184-4ab8-bfd9-98b3ef3cfbde tempest-AbsoluteLimitsTests-1691297929 None] Lock "cinder-25d5aaaa-716b-46d5-b51b-a14dd8e2414b-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:32 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:10:32 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:33 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 1 in 0.976s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Downloaded image f7bc816f-25b0-408e-baa1-85adebe218d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}])) to volume 631cad3b-e53b-48c7-b3fc-11195a1e9030 successfully. {{(pid=84523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Temporary image f7bc816f-25b0-408e-baa1-85adebe218d0 for user 07726fc3ed6541549b34480de000fe73 is deleted. {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Marking volume 631cad3b-e53b-48c7-b3fc-11195a1e9030 as bootable. {{(pid=84523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Copying metadata from image f7bc816f-25b0-408e-baa1-85adebe218d0 to 631cad3b-e53b-48c7-b3fc-11195a1e9030. {{(pid=84523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Creating volume glance metadata for volume 631cad3b-e53b-48c7-b3fc-11195a1e9030 backed by image f7bc816f-25b0-408e-baa1-85adebe218d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8a0353-2439-4f08-816e-243bea680451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631cad3b-e53b-48c7-b3fc-11195a1e9030', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d174b3d-dd84-4459-86b5-649c8cdbe97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:33 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Volume volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 (631cad3b-e53b-48c7-b3fc-11195a1e9030): created successfully Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d174b3d-dd84-4459-86b5-649c8cdbe97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Flow 'volume_create_manager' (cdfb464b-25d3-4036-a9cb-743b1625b911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-9154f7fd-5599-40bb-9e68-6664133d7f69 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Created volume successfully. Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[73541411-36b3-4899-a60a-407ac2eef266]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:34 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:10:34 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Flow 'volume_create_manager' (468510cf-4533-497a-863f-cbf2a9310e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4115df5-5ba3-4abc-b32f-abea57945875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:35 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 0 in 1.254s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4115df5-5ba3-4abc-b32f-abea57945875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-263345342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a141865-164b-48c7-9360-c68320137283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40f3ae819444d46b29b44a4d6f3e2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:35Z,use_quota=True,user_id='7702883280b14688a6cfbd9a522039ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef1a0f7-e856-4e0a-9134-bd2d46f97c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef1a0f7-e856-4e0a-9134-bd2d46f97c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec8419-a8ec-4ab5-b67f-af1b06cabb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec8419-a8ec-4ab5-b67f-af1b06cabb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a141865-164b-48c7-9360-c68320137283', 'volume_name': 'volume-9a141865-164b-48c7-9360-c68320137283', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db85a798-9893-4172-8a86-77c2fe514d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db85a798-9893-4172-8a86-77c2fe514d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ece407-e9c0-42a7-b444-65257cb79414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:35 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Volume 9a141865-164b-48c7-9360-c68320137283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a141865-164b-48c7-9360-c68320137283', 'volume_size': 1} Apr 29 19:10:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:35 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:10:35 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:35 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 1 in 0.835s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.134s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-263345342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a141865-164b-48c7-9360-c68320137283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c40f3ae819444d46b29b44a4d6f3e2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:35Z,use_quota=True,user_id='7702883280b14688a6cfbd9a522039ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Creating volume 9a141865-164b-48c7-9360-c68320137283 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:36 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:36 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 1073741824 Apr 29 19:10:36 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2', 'name': 'volume-631cad3b-e53b-48c7-b3fc-11195a1e9030', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cf592e4-1ca5-443d-ae88-866a814d1a48', 'enforce_multipath': True} {{(pid=84523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Apr 29 19:10:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-64e9de07-8d3b-44e2-89c4-9128f4191050 req-c1a7a111-8664-4add-a8b6-3425f3e8381a tempest-ServerBootFromVolumeStableRescueTest-271307905 None] attachment_update completed successfully. Apr 29 19:10:37 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 1073741824" returned: 0 in 1.101s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:37 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 Apr 29 19:10:37 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:37 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283" returned: 0 in 0.698s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ece407-e9c0-42a7-b444-65257cb79414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a141865-164b-48c7-9360-c68320137283', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fe7bb6-1e20-4b92-af0b-1e9ebd3e9587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:37 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Volume volume-9a141865-164b-48c7-9360-c68320137283 (9a141865-164b-48c7-9360-c68320137283): created successfully Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fe7bb6-1e20-4b92-af0b-1e9ebd3e9587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:37 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Flow 'volume_create_manager' (468510cf-4533-497a-863f-cbf2a9310e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:37 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e21ea19f-853f-406b-adbe-eac022d4315a tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Created volume successfully. Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Flow 'volume_create_manager' (58e9d17b-d94b-426b-8699-b7173b3bfb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36939b21-eaa8-4426-ab9d-5d02df7b9db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36939b21-eaa8-4426-ab9d-5d02df7b9db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-930268362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3340c6-4a77-4ab8-89d3-369c36d3c542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449022fdb8304d17af3ee8de90a18a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:39Z,use_quota=True,user_id='4c3d29ce732646a88fd074cb33b00995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e332c2f4-021c-4995-a8d1-d34d469b93cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e332c2f4-021c-4995-a8d1-d34d469b93cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77bc0b4-3b51-487f-a0f8-41f803f48459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77bc0b4-3b51-487f-a0f8-41f803f48459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e3340c6-4a77-4ab8-89d3-369c36d3c542', 'volume_name': 'volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d829a36f-1d4b-464f-a054-cd868a6f332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d829a36f-1d4b-464f-a054-cd868a6f332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d438ecb-4456-481b-9374-2110d31afacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:38 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Volume 0e3340c6-4a77-4ab8-89d3-369c36d3c542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542', 'volume_size': 1} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-930268362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3340c6-4a77-4ab8-89d3-369c36d3c542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449022fdb8304d17af3ee8de90a18a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:39Z,use_quota=True,user_id='4c3d29ce732646a88fd074cb33b00995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Creating volume 0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:38 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:10:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:39 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 1073741824 Apr 29 19:10:39 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Acquiring lock "cinder-9a141865-164b-48c7-9360-c68320137283-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "cinder-9a141865-164b-48c7-9360-c68320137283-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Acquiring lock "cinder-quobyte-9a141865-164b-48c7-9360-c68320137283" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "cinder-quobyte-9a141865-164b-48c7-9360-c68320137283" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[153cb293-5218-484f-8168-c16953146af5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:39 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 Apr 29 19:10:39 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:39 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 1073741824" returned: 0 in 0.916s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:39 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 Apr 29 19:10:39 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:40 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283" returned: 0 in 0.793s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:40 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283 Apr 29 19:10:40 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:40 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542" returned: 0 in 0.650s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d438ecb-4456-481b-9374-2110d31afacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c15369-c203-4bb6-9c7f-7ed6f96aec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:40 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Volume volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 (0e3340c6-4a77-4ab8-89d3-369c36d3c542): created successfully Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c15369-c203-4bb6-9c7f-7ed6f96aec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Flow 'volume_create_manager' (58e9d17b-d94b-426b-8699-b7173b3bfb19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3c79746a-f8ee-41e2-a751-2fc6618514d1 tempest-VolumesDeleteCascade-965252427 None] Created volume successfully. Apr 29 19:10:41 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a141865-164b-48c7-9360-c68320137283" returned: 0 in 0.735s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "cinder-quobyte-9a141865-164b-48c7-9360-c68320137283" released by "delete_volume" :: held 1.575s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Created reservations ['1f22d91c-bd2a-4793-b3b4-8c1e15cbdb21', 'ea9def8e-9e29-4fac-8866-ca45ab67f4b7', '3e7243ce-234b-49d1-b90c-3f5c870bfd39', '5a534be9-8c3c-4c8c-81d3-b688f1c9d19f'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:41 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:10:41 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Creating offline snapshot f4f181ed-1d20-41ff-8550-f6d9bba68c20 of volume 0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf624c2f-8bc3-4057-b70f-797c6dae13f1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:41 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 Apr 29 19:10:41 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:42 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.063s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:42 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:10:42 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Deleted volume successfully. Apr 29 19:10:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7360cacc-7409-4e65-aa25-450cb2496732 tempest-VolumeQuotasNegativeTestJSON-1124415947 None] Lock "cinder-9a141865-164b-48c7-9360-c68320137283-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:42 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542" returned: 0 in 1.353s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:42 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 1G Apr 29 19:10:42 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:44 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 1G" returned: 0 in 1.324s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:44 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 Apr 29 19:10:44 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:45 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20" returned: 0 in 1.129s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:45 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 is being set with open permissions: ugo+rw Apr 29 19:10:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:45 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 Apr 29 19:10:45 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:46 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20" returned: 0 in 0.795s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:46 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.info Apr 29 19:10:46 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:47 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.info" returned: 0 in 0.936s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:47 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.info is being set with open permissions: ugo+rw Apr 29 19:10:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:47 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.info Apr 29 19:10:47 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:48 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.info" returned: 0 in 0.962s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.700s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:48 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b5c1940b-25fb-49d5-9846-0e9cab01d09a tempest-VolumesDeleteCascade-965252427 None] Create snapshot completed successfully Apr 29 19:10:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Creating offline snapshot 2e94dd58-417f-4634-9cf5-c1d252113367 of volume 0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:10:49 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2537be-749a-49ea-a639-0bbd54bcb4d8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:49 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 Apr 29 19:10:49 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:50 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20" returned: 0 in 0.919s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:50 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 1G Apr 29 19:10:50 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Flow 'volume_create_manager' (c3793314-a588-439b-801d-66987f71b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5213f3-c805-4d05-b124-a0a8eff9a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5213f3-c805-4d05-b124-a0a8eff9a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-132307358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ad9d36-63e9-4f14-9c4a-5d39e915221d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04130d4fa2343ffa23bbb3347a013bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:51Z,use_quota=True,user_id='45af2d077b7d4fbabb65316261fa0362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad494e8-56e2-4db0-a984-f7b18df12dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad494e8-56e2-4db0-a984-f7b18df12dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e5c07d-ba90-4fda-9e7c-95679c662571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e5c07d-ba90-4fda-9e7c-95679c662571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ad9d36-63e9-4f14-9c4a-5d39e915221d', 'volume_name': 'volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f627235f-d379-4ad7-a0a4-23d294666f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f627235f-d379-4ad7-a0a4-23d294666f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db74ae23-c1ba-47e5-bdb2-f6369111ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Volume 73ad9d36-63e9-4f14-9c4a-5d39e915221d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d', 'volume_size': 1} Apr 29 19:10:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:51 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 1G" returned: 0 in 0.950s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:51 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 Apr 29 19:10:51 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:52 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367" returned: 0 in 1.389s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:52 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 is being set with open permissions: ugo+rw Apr 29 19:10:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:52 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 Apr 29 19:10:52 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:53 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367" returned: 0 in 1.142s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.598s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.719s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-132307358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ad9d36-63e9-4f14-9c4a-5d39e915221d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04130d4fa2343ffa23bbb3347a013bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:10:51Z,use_quota=True,user_id='45af2d077b7d4fbabb65316261fa0362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Creating volume 73ad9d36-63e9-4f14-9c4a-5d39e915221d {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:10:53 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:10:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:53 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d 1073741824 Apr 29 19:10:53 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1d87e01e-769d-4d8a-bda1-7302469b8393 tempest-VolumesDeleteCascade-965252427 None] Create snapshot completed successfully Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-0e3340c6-4a77-4ab8-89d3-369c36d3c542-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-0e3340c6-4a77-4ab8-89d3-369c36d3c542-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Performing cascade delete. {{(pid=84523) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-2e94dd58-417f-4634-9cf5-c1d252113367-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-2e94dd58-417f-4634-9cf5-c1d252113367-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-2e94dd58-417f-4634-9cf5-c1d252113367" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-2e94dd58-417f-4634-9cf5-c1d252113367" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Deleting offline snapshot 2e94dd58-417f-4634-9cf5-c1d252113367 of volume 0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] snapshot_file for this snap is: volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ee285c-88d0-4417-a2c5-2ee41fef246a]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:54 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:54 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 Apr 29 19:10:54 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d 1073741824" returned: 0 in 1.212s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:55 devstack sudo[87161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d Apr 29 19:10:55 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:56 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d" returned: 0 in 1.093s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] <== create_volume: return (2387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:56 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367" returned: 0 in 1.312s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5294b1-b0d8-4a49-9dba-1c39a54f3930]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db74ae23-c1ba-47e5-bdb2-f6369111ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ac2907-8b75-4e8d-84f2-04c73ee26977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:10:56 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Volume volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d (73ad9d36-63e9-4f14-9c4a-5d39e915221d): created successfully Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ac2907-8b75-4e8d-84f2-04c73ee26977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Flow 'volume_create_manager' (c3793314-a588-439b-801d-66987f71b30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:10:56 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9d8f6750-62dc-4e67-9565-8fde69afb7fe tempest-VolumesServicesTestJSON-478041488 None] Created volume successfully. Apr 29 19:10:56 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 Apr 29 19:10:56 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Acquiring lock "cinder-73ad9d36-63e9-4f14-9c4a-5d39e915221d-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Lock "cinder-73ad9d36-63e9-4f14-9c4a-5d39e915221d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Acquiring lock "cinder-quobyte-73ad9d36-63e9-4f14-9c4a-5d39e915221d" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Lock "cinder-quobyte-73ad9d36-63e9-4f14-9c4a-5d39e915221d" acquired by "delete_volume" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4001135-3960-40a9-8ddb-f6aaec738686]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:10:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:57 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d Apr 29 19:10:57 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:57 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20" returned: 0 in 1.264s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:10:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:57 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 Apr 29 19:10:57 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:57 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d" returned: 0 in 0.989s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:58 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d Apr 29 19:10:58 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:58 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367" returned: 0 in 1.113s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:58 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367 Apr 29 19:10:58 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:58 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-73ad9d36-63e9-4f14-9c4a-5d39e915221d" returned: 0 in 0.692s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Lock "cinder-quobyte-73ad9d36-63e9-4f14-9c4a-5d39e915221d" released by "delete_volume" :: held 1.762s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Created reservations ['6d91b8d8-6e17-4134-887c-56ffc2d45436', 'eb9a2290-0243-4e0c-9ca0-8f831fee7568', '1c97b43d-573f-40aa-b464-55978ca9ba35', '1d32dc11-fed6-4704-9f2b-6b0d379f7d46'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:10:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:10:58 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:10:58 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:10:59 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.2e94dd58-417f-4634-9cf5-c1d252113367" returned: 0 in 1.016s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-2e94dd58-417f-4634-9cf5-c1d252113367" released by "_delete_snapshot" :: held 4.913s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" released by "delete_snapshot" :: held 4.945s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:59 devstack cinder-volume[84523]: WARNING cinder.quota [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Created reservations ['4df1b606-bf1e-4987-87cc-f8ea0912a7da', 'b8a288ea-a240-4ee7-8479-7f4be6fbe77c', 'f7811654-4a98-4e0a-8c8b-c855549b3260', '23f5f0bd-1b75-441c-ab19-ab1e70132d4d'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:10:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Delete snapshot completed successfully. Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-2e94dd58-417f-4634-9cf5-c1d252113367-delete_snapshot" released by "delete_snapshot" :: held 5.167s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-f4f181ed-1d20-41ff-8550-f6d9bba68c20-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-f4f181ed-1d20-41ff-8550-f6d9bba68c20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-f4f181ed-1d20-41ff-8550-f6d9bba68c20" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-f4f181ed-1d20-41ff-8550-f6d9bba68c20" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Deleting offline snapshot f4f181ed-1d20-41ff-8550-f6d9bba68c20 of volume 0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:10:59 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] snapshot_file for this snap is: volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.134s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:10:59 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:00 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Deleted volume successfully. Apr 29 19:11:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[24416faf-c6f0-4714-89ed-311d455003f7]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7bec9d4a-9c90-4342-b4a8-c18464ebd9b1 tempest-VolumesServicesTestJSON-478041488 None] Lock "cinder-73ad9d36-63e9-4f14-9c4a-5d39e915221d-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:00 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 Apr 29 19:11:00 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:00 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20" returned: 0 in 0.884s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:11:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9251828-f1e0-4834-a23e-e4120c6bc48d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:01 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 Apr 29 19:11:01 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:02 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542" returned: 0 in 1.867s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:02 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 Apr 29 19:11:02 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:04 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20" returned: 0 in 1.706s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:04 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20 Apr 29 19:11:04 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:05 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542.f4f181ed-1d20-41ff-8550-f6d9bba68c20" returned: 0 in 1.168s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-f4f181ed-1d20-41ff-8550-f6d9bba68c20" released by "_delete_snapshot" :: held 5.862s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" released by "delete_snapshot" :: held 5.917s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:06 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Created reservations ['7465fc4f-6c0e-4282-bb3d-0b2b5df28581', '8f28a034-d09e-4849-8628-cfb09b6ff478', 'd4766f6f-f96e-45bb-8ff4-bec9a35f4aca', '529019e8-1f41-4c44-9575-473f71550c29'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:06 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Delete snapshot completed successfully. Apr 29 19:11:06 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-f4f181ed-1d20-41ff-8550-f6d9bba68c20-delete_snapshot" released by "delete_snapshot" :: held 6.374s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Snapshots deleted, issuing volume delete {{(pid=84523) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Apr 29 19:11:06 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:06 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" acquired by "delete_volume" :: waited 0.042s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:06 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[858bf58b-4333-48f6-9dee-be1fc7fbc043]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:06 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 Apr 29 19:11:06 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:08 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542" returned: 0 in 1.887s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:08 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542 Apr 29 19:11:08 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:09 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0e3340c6-4a77-4ab8-89d3-369c36d3c542" returned: 0 in 0.855s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-0e3340c6-4a77-4ab8-89d3-369c36d3c542" released by "delete_volume" :: held 2.891s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=73,cinder:SELECT=59,cinder:INSERT=22,cinder:DELETE=3 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Created reservations ['1ff848f6-fe49-43c3-bf1b-0800cf3c8aea', 'c33a8a35-127e-4536-be4f-8709ea416b0c', '657797f5-f15f-4770-9fd9-2e450de71fb1', 'e0c4f7cc-b659-4f75-8ee6-1acf87d5ab58'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:09 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:09 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Flow 'volume_create_manager' (5e4a9124-c67d-469e-a65f-cabd795aa494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f24965f-1846-48f0-b32c-4bc67df990ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f24965f-1846-48f0-b32c-4bc67df990ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2144478580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c728cb24-e79f-41ff-bf68-f5e77389f3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c09c1ca6374a7590ab45a753b1819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:10Z,use_quota=True,user_id='a10c78a9f3a544e9a1ed3e00312eac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58425219-c42f-44ab-8eea-ab8628006f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58425219-c42f-44ab-8eea-ab8628006f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da392f0-be4e-4660-b310-a939b0d4bae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5da392f0-be4e-4660-b310-a939b0d4bae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c728cb24-e79f-41ff-bf68-f5e77389f3bd', 'volume_name': 'volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65ec2af-fa6e-4bca-a091-4d705964e284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65ec2af-fa6e-4bca-a091-4d705964e284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2501ad-7800-40b6-aa88-1a1199a508eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:09 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Volume c728cb24-e79f-41ff-bf68-f5e77389f3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd', 'volume_size': 1} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2144478580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c728cb24-e79f-41ff-bf68-f5e77389f3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c09c1ca6374a7590ab45a753b1819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:10Z,use_quota=True,user_id='a10c78a9f3a544e9a1ed3e00312eac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Creating volume c728cb24-e79f-41ff-bf68-f5e77389f3bd {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:09 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:11:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:09 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd 1073741824 Apr 29 19:11:09 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:10 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.944s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Deleted volume successfully. Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c75fc073-9bce-4c3c-bcb1-c0ba48a3bb73 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-0e3340c6-4a77-4ab8-89d3-369c36d3c542-delete_volume" released by "delete_volume" :: held 15.868s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Flow 'volume_create_manager' (57847a18-ba76-44df-82e2-6374433a90e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7ec8ef-cb1d-4887-a7c7-8fc3080a302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7ec8ef-cb1d-4887-a7c7-8fc3080a302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1099114149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac69ea0c-b46d-4c96-bbb8-31bc34f35260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449022fdb8304d17af3ee8de90a18a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:11Z,use_quota=True,user_id='4c3d29ce732646a88fd074cb33b00995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5939a2ca-72ee-4c90-a46a-6e7fe081649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5939a2ca-72ee-4c90-a46a-6e7fe081649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba11c93-01dc-45b3-b053-8ad5f448e874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba11c93-01dc-45b3-b053-8ad5f448e874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac69ea0c-b46d-4c96-bbb8-31bc34f35260', 'volume_name': 'volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8210147f-0cf5-4f5b-a91f-b8f44f075fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8210147f-0cf5-4f5b-a91f-b8f44f075fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bfda92-7801-4b19-81f3-3c7148329aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:10 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Volume ac69ea0c-b46d-4c96-bbb8-31bc34f35260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260', 'volume_size': 1} Apr 29 19:11:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:11 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd 1073741824" returned: 0 in 1.551s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:11 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd Apr 29 19:11:11 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:12 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd" returned: 0 in 0.812s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] <== create_volume: return (2421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1099114149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac69ea0c-b46d-4c96-bbb8-31bc34f35260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449022fdb8304d17af3ee8de90a18a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:11Z,use_quota=True,user_id='4c3d29ce732646a88fd074cb33b00995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Creating volume ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:12 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:12 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 1073741824 Apr 29 19:11:12 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2501ad-7800-40b6-aa88-1a1199a508eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5793cf-c065-4202-8351-062960b3793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:12 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Volume volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd (c728cb24-e79f-41ff-bf68-f5e77389f3bd): created successfully Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5793cf-c065-4202-8351-062960b3793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Flow 'volume_create_manager' (5e4a9124-c67d-469e-a65f-cabd795aa494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:12 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2f4406aa-328f-4749-a2c5-ef7d69b8f121 tempest-VolumesListAdminTestJSON-966378983 None] Created volume successfully. Apr 29 19:11:13 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 1073741824" returned: 0 in 1.421s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:13 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 Apr 29 19:11:13 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:13 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Flow 'volume_create_manager' (f0ce89b1-21e3-41a5-b89f-3d5c4b2939cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ccd0d1-2aae-424b-9c96-bb1077ed1ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ccd0d1-2aae-424b-9c96-bb1077ed1ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1348993899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1c7696-e56a-4a74-a29a-be1e9e0a07b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c09c1ca6374a7590ab45a753b1819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:14Z,use_quota=True,user_id='a10c78a9f3a544e9a1ed3e00312eac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8362b01e-c28c-477e-bf39-fdf844b20890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8362b01e-c28c-477e-bf39-fdf844b20890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3b12e5-d3d8-4e76-844f-34701d348c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3b12e5-d3d8-4e76-844f-34701d348c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1c7696-e56a-4a74-a29a-be1e9e0a07b8', 'volume_name': 'volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae573b-161d-4ab5-babf-09428543b8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae573b-161d-4ab5-babf-09428543b8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffafbd5-00ca-4e70-b0e3-b571bfb2de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:14 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Volume 9a1c7696-e56a-4a74-a29a-be1e9e0a07b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8', 'volume_size': 1} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:14 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" returned: 0 in 1.113s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] <== create_volume: return (2610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1348993899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1c7696-e56a-4a74-a29a-be1e9e0a07b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c09c1ca6374a7590ab45a753b1819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:14Z,use_quota=True,user_id='a10c78a9f3a544e9a1ed3e00312eac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Creating volume 9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:14 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:11:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bfda92-7801-4b19-81f3-3c7148329aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:15 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 1073741824 Apr 29 19:11:15 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dd8316-7977-44e1-accc-4694271fc130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:15 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Volume volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 (ac69ea0c-b46d-4c96-bbb8-31bc34f35260): created successfully Apr 29 19:11:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dd8316-7977-44e1-accc-4694271fc130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Flow 'volume_create_manager' (57847a18-ba76-44df-82e2-6374433a90e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:15 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5d08b8c1-0218-42c8-9ae0-36c5c221f1a0 tempest-VolumesDeleteCascade-965252427 None] Created volume successfully. Apr 29 19:11:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:16 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 1073741824" returned: 0 in 1.639s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:16 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 Apr 29 19:11:16 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:17 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8" returned: 0 in 0.818s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] <== create_volume: return (2528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.532s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.616s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffafbd5-00ca-4e70-b0e3-b571bfb2de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479b5045-d7c0-475f-87c2-740a914f485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Creating offline snapshot 201ddb69-df08-4238-b8b0-1bfce69da764 of volume ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:11:17 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Volume volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 (9a1c7696-e56a-4a74-a29a-be1e9e0a07b8): created successfully Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479b5045-d7c0-475f-87c2-740a914f485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Flow 'volume_create_manager' (f0ce89b1-21e3-41a5-b89f-3d5c4b2939cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cabb47f-b39d-4769-96eb-ce189b169bad]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6757e481-e98a-4483-a87c-ea1f14c2230d tempest-VolumesListAdminTestJSON-966378983 None] Created volume successfully. Apr 29 19:11:17 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 Apr 29 19:11:17 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:18 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" returned: 0 in 1.239s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:18 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 1G Apr 29 19:11:18 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Flow 'volume_create_manager' (46e0c9c7-6387-4afa-a93f-01f3704e983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff99cde-5d41-4f04-81d1-a3b320dcbf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff99cde-5d41-4f04-81d1-a3b320dcbf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1553219580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8772a958-b2e9-4079-b7c5-ab828ad7f17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c09c1ca6374a7590ab45a753b1819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:19Z,use_quota=True,user_id='a10c78a9f3a544e9a1ed3e00312eac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b94ff13-a541-4abf-b1c1-b264cc9fcc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b94ff13-a541-4abf-b1c1-b264cc9fcc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06d957c-fb47-40cd-b408-d8ca3833d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06d957c-fb47-40cd-b408-d8ca3833d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8772a958-b2e9-4079-b7c5-ab828ad7f17a', 'volume_name': 'volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f234b8a-b451-4fde-9360-6414a472645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f234b8a-b451-4fde-9360-6414a472645b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b0ded1-eb79-4c12-8f97-9655d22fc10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:19 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Volume 8772a958-b2e9-4079-b7c5-ab828ad7f17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a', 'volume_size': 1} Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:19 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-cebca786-1742-4475-a3c0-94fd60b98f3e tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Terminate volume connection completed successfully. Apr 29 19:11:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-cebca786-1742-4475-a3c0-94fd60b98f3e tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Deleting attachment 5cf592e4-1ca5-443d-ae88-866a814d1a48. {{(pid=84523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Apr 29 19:11:20 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 1G" returned: 0 in 1.286s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:20 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 Apr 29 19:11:20 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "cinder-631cad3b-e53b-48c7-b3fc-11195a1e9030-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "cinder-631cad3b-e53b-48c7-b3fc-11195a1e9030-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "cinder-quobyte-631cad3b-e53b-48c7-b3fc-11195a1e9030" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "cinder-quobyte-631cad3b-e53b-48c7-b3fc-11195a1e9030" acquired by "delete_volume" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[844af2e3-8e79-4a55-9df5-87ad5a7388e5]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:20 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:11:20 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:20 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764" returned: 0 in 0.822s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:20 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 is being set with open permissions: ugo+rw Apr 29 19:11:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:20 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 Apr 29 19:11:20 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:21 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 0 in 0.836s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:21 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:11:21 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:21 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764" returned: 0 in 0.842s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:21 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.info Apr 29 19:11:21 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:22 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 1 in 0.857s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:22 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030 Apr 29 19:11:22 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:22 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.info" returned: 0 in 0.691s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:22 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.info is being set with open permissions: ugo+rw Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:22 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.info Apr 29 19:11:22 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:22 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-631cad3b-e53b-48c7-b3fc-11195a1e9030" returned: 0 in 0.692s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "cinder-quobyte-631cad3b-e53b-48c7-b3fc-11195a1e9030" released by "delete_volume" :: held 2.453s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG cinder.quota [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Created reservations ['74d6c86d-ad80-4597-9bb0-22086a477106', '1b918012-0ae2-4ed7-8a78-f529ca81745b', '8a234dbd-1c88-41cc-9eb4-89ec24d0266f', '7b5544bc-9810-402a-9450-940a4df324ed'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:22 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:22 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:23 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.info" returned: 0 in 0.621s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.645s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1553219580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8772a958-b2e9-4079-b7c5-ab828ad7f17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c09c1ca6374a7590ab45a753b1819a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:19Z,use_quota=True,user_id='a10c78a9f3a544e9a1ed3e00312eac79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Creating volume 8772a958-b2e9-4079-b7c5-ab828ad7f17a {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:23 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:23 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a 1073741824 Apr 29 19:11:23 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:23 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d243d4a5-7c7b-4958-8605-9c2321aa5ccf tempest-VolumesDeleteCascade-965252427 None] Create snapshot completed successfully Apr 29 19:11:23 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.779s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG cinder.manager [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:23 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Deleted volume successfully. Apr 29 19:11:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-751308c7-6b4a-4fc1-937e-d9fa5fe5ee5f req-39d1bdb0-ea47-42aa-ab6a-69195d3c61ab tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "cinder-631cad3b-e53b-48c7-b3fc-11195a1e9030-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:24 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a 1073741824" returned: 0 in 0.924s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:24 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a Apr 29 19:11:24 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:24 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a" returned: 0 in 0.732s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b0ded1-eb79-4c12-8f97-9655d22fc10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78f6114-f8e4-48b8-a072-814177fc52a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:24 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Volume volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a (8772a958-b2e9-4079-b7c5-ab828ad7f17a): created successfully Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78f6114-f8e4-48b8-a072-814177fc52a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Flow 'volume_create_manager' (46e0c9c7-6387-4afa-a93f-01f3704e983c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:24 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-fee1d984-40a6-4b99-b0c8-c726c449fe87 tempest-VolumesListAdminTestJSON-966378983 None] Created volume successfully. Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Flow 'volume_create_manager' (47fea67e-c7f6-4fb9-bd84-c93922713c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318dc418-5b6c-49c3-8c64-e9af00b0ee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318dc418-5b6c-49c3-8c64-e9af00b0ee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-623326536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456ee63c-c1e9-4d91-ae31-80a8536578ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449022fdb8304d17af3ee8de90a18a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=201ddb69-df08-4238-b8b0-1bfce69da764,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:25Z,use_quota=True,user_id='4c3d29ce732646a88fd074cb33b00995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7d5702-09bb-4c66-b851-8916b3130bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7d5702-09bb-4c66-b851-8916b3130bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f4a9c3-d37b-44e4-9c94-5d276430a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f4a9c3-d37b-44e4-9c94-5d276430a338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '456ee63c-c1e9-4d91-ae31-80a8536578ea', 'volume_name': 'volume-456ee63c-c1e9-4d91-ae31-80a8536578ea', 'volume_size': 1, 'snapshot_id': '201ddb69-df08-4238-b8b0-1bfce69da764'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4028b56e-3310-4ef3-86c9-2e2718ed6f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4028b56e-3310-4ef3-86c9-2e2718ed6f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73704009-c00b-4211-bacb-2dddc9e04b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:25 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Volume 456ee63c-c1e9-4d91-ae31-80a8536578ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-456ee63c-c1e9-4d91-ae31-80a8536578ea', 'volume_size': 1, 'snapshot_id': '201ddb69-df08-4238-b8b0-1bfce69da764'} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-201ddb69-df08-4238-b8b0-1bfce69da764-456ee63c-c1e9-4d91-ae31-80a8536578ea" by "_create_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-201ddb69-df08-4238-b8b0-1bfce69da764-456ee63c-c1e9-4d91-ae31-80a8536578ea" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Creating volume 456ee63c-c1e9-4d91-ae31-80a8536578ea from snapshot 201ddb69-df08-4238-b8b0-1bfce69da764 {{(pid=84523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-456ee63c-c1e9-4d91-ae31-80a8536578ea" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-456ee63c-c1e9-4d91-ae31-80a8536578ea" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] snapshot: 201ddb69-df08-4238-b8b0-1bfce69da764, volume: 456ee63c-c1e9-4d91-ae31-80a8536578ea, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d199343-1db5-499d-b094-8e0ad6eef287]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:25 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 Apr 29 19:11:25 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:26 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764" returned: 0 in 1.027s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a79fed-f2ce-4e7c-85eb-f74780c4c14e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:26 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 Apr 29 19:11:26 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Flow 'volume_create_manager' (e3431088-007f-4577-bba1-1829ddebb647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e11133-85a5-4d17-8895-da4f610ec2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e11133-85a5-4d17-8895-da4f610ec2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72dbd4c-1045-424f-8938-f81789059ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c359778011b418883b16c0938588fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:26Z,use_quota=True,user_id='044e938112974495b915860c8ffd1cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef142890-95e9-4960-a3f9-0050f1d1f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef142890-95e9-4960-a3f9-0050f1d1f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56977ee5-3eb7-4bad-b482-9e6fac2759e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56977ee5-3eb7-4bad-b482-9e6fac2759e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72dbd4c-1045-424f-8938-f81789059ad7', 'volume_name': 'volume-b72dbd4c-1045-424f-8938-f81789059ad7', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6baaf6-e52d-466b-b1b8-0f1d688f10b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6baaf6-e52d-466b-b1b8-0f1d688f10b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a4799b-c1c4-47d9-b339-50677c3880d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:26 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Volume b72dbd4c-1045-424f-8938-f81789059ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72dbd4c-1045-424f-8938-f81789059ad7', 'volume_size': 1} Apr 29 19:11:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Flow 'volume_create_manager' (88cb07d2-b89d-4645-87b7-213684da232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0540349-bd45-41ff-b5c2-6611bd123f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0540349-bd45-41ff-b5c2-6611bd123f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-449363554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6ae5c3-9f5b-441f-8948-93367390198d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5084a927414fd68bcc315459720a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:27Z,use_quota=True,user_id='12508e2653b249aeacdda8ebfadca3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a2d7e0-b8e6-4b4e-87e9-ad538d97272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a2d7e0-b8e6-4b4e-87e9-ad538d97272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14851b7-a33f-431d-9da5-b04038edf02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14851b7-a33f-431d-9da5-b04038edf02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6ae5c3-9f5b-441f-8948-93367390198d', 'volume_name': 'volume-dc6ae5c3-9f5b-441f-8948-93367390198d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2048c7-4265-4ec6-8652-f4ab5550d4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2048c7-4265-4ec6-8652-f4ab5550d4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d74e45f-8206-4d02-8c66-5313af0a7b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:27 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Volume dc6ae5c3-9f5b-441f-8948-93367390198d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6ae5c3-9f5b-441f-8948-93367390198d', 'volume_size': 1} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:27 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" returned: 0 in 0.999s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:11:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:27 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea Apr 29 19:11:27 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:11:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:29 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:29 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:30 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.198s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:11:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:11:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:11:32 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea" returned: 0 in 5.528s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:32 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[204960ce-d8fd-43e4-b055-feadfdc2cf8b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:33 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 Apr 29 19:11:33 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:33 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" returned: 0 in 1.003s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:33 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:11:33 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Converted 1024.00 MB image at 185.19 MB/s Apr 29 19:11:33 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea is being set with open permissions: ugo+rw Apr 29 19:11:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:33 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea Apr 29 19:11:33 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:34 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea" returned: 0 in 0.594s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-456ee63c-c1e9-4d91-ae31-80a8536578ea" released by "_copy_volume_from_snapshot" :: held 9.328s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-201ddb69-df08-4238-b8b0-1bfce69da764-456ee63c-c1e9-4d91-ae31-80a8536578ea" released by "_create_volume_from_snapshot" :: held 9.358s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.376s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.951s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72dbd4c-1045-424f-8938-f81789059ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c359778011b418883b16c0938588fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:26Z,use_quota=True,user_id='044e938112974495b915860c8ffd1cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Creating volume b72dbd4c-1045-424f-8938-f81789059ad7 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:34 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=73,cinder:SELECT=74,cinder:DELETE=9,cinder:INSERT=26 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:11:34 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 1073741824 Apr 29 19:11:34 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73704009-c00b-4211-bacb-2dddc9e04b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456ee63c-c1e9-4d91-ae31-80a8536578ea', 'volume_size': 1, 'snapshot_id': '201ddb69-df08-4238-b8b0-1bfce69da764'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1a7d9c-a07d-4bf7-adbd-90efeff5bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:34 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Volume volume-456ee63c-c1e9-4d91-ae31-80a8536578ea (456ee63c-c1e9-4d91-ae31-80a8536578ea): created successfully Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1a7d9c-a07d-4bf7-adbd-90efeff5bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Flow 'volume_create_manager' (47fea67e-c7f6-4fb9-bd84-c93922713c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:34 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a89b18b9-b714-4dfb-9b5e-44bdf8ede113 tempest-VolumesDeleteCascade-965252427 None] Created volume successfully. Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-ac69ea0c-b46d-4c96-bbb8-31bc34f35260-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-ac69ea0c-b46d-4c96-bbb8-31bc34f35260-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Performing cascade delete. {{(pid=84523) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-201ddb69-df08-4238-b8b0-1bfce69da764-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-201ddb69-df08-4238-b8b0-1bfce69da764-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-201ddb69-df08-4238-b8b0-1bfce69da764" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:35 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-201ddb69-df08-4238-b8b0-1bfce69da764" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Deleting offline snapshot 201ddb69-df08-4238-b8b0-1bfce69da764 of volume ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] snapshot_file for this snap is: volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 1073741824" returned: 0 in 0.905s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc8826c-2816-42ab-b6ac-852e96656296]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:35 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 Apr 29 19:11:35 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:35 devstack sudo[87744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 Apr 29 19:11:35 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:35 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-fe4f467b-9ca8-4589-a511-72bc4e8e7842 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Terminate volume connection completed successfully. Apr 29 19:11:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-fe4f467b-9ca8-4589-a511-72bc4e8e7842 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Deleting attachment fe7e0012-9a23-415f-899f-12fb405b83e9. {{(pid=84523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Apr 29 19:11:36 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7" returned: 0 in 0.579s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.864s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-449363554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6ae5c3-9f5b-441f-8948-93367390198d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5084a927414fd68bcc315459720a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:27Z,use_quota=True,user_id='12508e2653b249aeacdda8ebfadca3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Creating volume dc6ae5c3-9f5b-441f-8948-93367390198d {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:36 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:36 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d 1073741824 Apr 29 19:11:36 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a4799b-c1c4-47d9-b339-50677c3880d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72dbd4c-1045-424f-8938-f81789059ad7', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a79b863-4a34-495b-86f4-6de9b1cf9e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:36 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Volume volume-b72dbd4c-1045-424f-8938-f81789059ad7 (b72dbd4c-1045-424f-8938-f81789059ad7): created successfully Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a79b863-4a34-495b-86f4-6de9b1cf9e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Flow 'volume_create_manager' (e3431088-007f-4577-bba1-1829ddebb647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3614276d-a614-4706-91b1-076c1bf357f9 tempest-VolumesListAdminTestJSON-1681795155 None] Created volume successfully. Apr 29 19:11:36 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764" returned: 0 in 0.711s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a78fa80-8d09-4155-b7a1-ed72f979e0ee]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:36 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 Apr 29 19:11:36 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Acquiring lock "cinder-b72dbd4c-1045-424f-8938-f81789059ad7-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "cinder-b72dbd4c-1045-424f-8938-f81789059ad7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Acquiring lock "cinder-quobyte-b72dbd4c-1045-424f-8938-f81789059ad7" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "cinder-quobyte-b72dbd4c-1045-424f-8938-f81789059ad7" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d09cb34-d877-4f36-8bf9-ecc649b699a8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "cinder-8772a958-b2e9-4079-b7c5-ab828ad7f17a-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "cinder-71158f3a-ebd2-4bae-b421-4cd7f5a22198-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "cinder-71158f3a-ebd2-4bae-b421-4cd7f5a22198-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-8772a958-b2e9-4079-b7c5-ab828ad7f17a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "cinder-quobyte-8772a958-b2e9-4079-b7c5-ab828ad7f17a" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "cinder-quobyte-71158f3a-ebd2-4bae-b421-4cd7f5a22198" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-quobyte-8772a958-b2e9-4079-b7c5-ab828ad7f17a" acquired by "delete_volume" :: waited 0.040s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "cinder-quobyte-71158f3a-ebd2-4bae-b421-4cd7f5a22198" acquired by "delete_volume" :: waited 0.050s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:36 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 Apr 29 19:11:36 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[588913d3-de18-45da-81b6-b36c13a4e15e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[951a4eec-a296-4cc8-915f-86fc7aeb206b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:36 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a Apr 29 19:11:36 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:36 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 Apr 29 19:11:36 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:37 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d 1073741824" returned: 0 in 1.142s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:37 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d Apr 29 19:11:37 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:37 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" returned: 0 in 1.384s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:37 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 Apr 29 19:11:37 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:38 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a" returned: 0 in 1.261s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:38 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a Apr 29 19:11:38 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:38 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7" returned: 0 in 1.550s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:38 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7 Apr 29 19:11:38 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:38 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198" returned: 0 in 1.378s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:38 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198 Apr 29 19:11:38 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:38 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d" returned: 0 in 1.141s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] <== create_volume: return (2454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d74e45f-8206-4d02-8c66-5313af0a7b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6ae5c3-9f5b-441f-8948-93367390198d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615d22b6-c7bd-491e-a287-f757458be38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:38 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Volume volume-dc6ae5c3-9f5b-441f-8948-93367390198d (dc6ae5c3-9f5b-441f-8948-93367390198d): created successfully Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615d22b6-c7bd-491e-a287-f757458be38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Flow 'volume_create_manager' (88cb07d2-b89d-4645-87b7-213684da232d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-701f51c7-5207-45ad-a8ac-b01cb565bb7c tempest-ServersNegativeTestJSON-1569066157 None] Created volume successfully. Apr 29 19:11:38 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764" returned: 0 in 1.105s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:38 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764 Apr 29 19:11:38 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:38 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8772a958-b2e9-4079-b7c5-ab828ad7f17a" returned: 0 in 0.799s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-quobyte-8772a958-b2e9-4079-b7c5-ab828ad7f17a" released by "delete_volume" :: held 2.142s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:38 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Created reservations ['be8e4540-df29-4fc4-a7a2-9f3b0c6209d7', '519e9e8e-da68-47dd-b614-e0c7dfb772f4', 'd7460090-ec8d-471b-b555-cdc6a5aa6f68', '95ee8401-ec73-4b4f-bf63-589e44c726ad'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b72dbd4c-1045-424f-8938-f81789059ad7" returned: 0 in 0.891s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "cinder-quobyte-b72dbd4c-1045-424f-8938-f81789059ad7" released by "delete_volume" :: held 2.528s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:39 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-71158f3a-ebd2-4bae-b421-4cd7f5a22198" returned: 0 in 0.901s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "cinder-quobyte-71158f3a-ebd2-4bae-b421-4cd7f5a22198" released by "delete_volume" :: held 2.360s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Created reservations ['d2f41eda-0c54-45b7-81a8-e7a69dbe2d0d', '0898dcdd-0013-4a1f-b351-42eae176b693', 'e305aedf-f92b-404a-b31b-5d92b86a28bf', '79b22aab-e9c7-4f31-991a-5ae094fd231a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:39 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:39 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.quota [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Created reservations ['0d548c90-4c4f-4e0a-90b9-83bc3939631c', 'cef250dd-7314-4741-b505-60971fcee7b6', 'c89f67fe-826d-4d19-9ada-e4698484809f', '2e63969f-99f7-49fc-9339-3bcd2738512a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:39 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:39 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:39 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:39 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:39 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260.201ddb69-df08-4238-b8b0-1bfce69da764" returned: 0 in 0.898s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-201ddb69-df08-4238-b8b0-1bfce69da764" released by "_delete_snapshot" :: held 4.220s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" released by "delete_snapshot" :: held 4.244s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Created reservations ['81c99a80-cb24-4f4a-b3f7-6dc51b2297d0', '5312a0a1-4564-434f-9849-f38592bf8b7f', '5097c2e3-fb72-4ce4-bd18-dfeef2a4b467', 'd311d821-589c-4fcf-9cd2-35207d8287fd'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:39 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Delete snapshot completed successfully. Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-201ddb69-df08-4238-b8b0-1bfce69da764-delete_snapshot" released by "delete_snapshot" :: held 4.541s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Snapshots deleted, issuing volume delete {{(pid=84523) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8575fa1-790e-4927-bde4-d2d77eb15395]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:40 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.815s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Deleted volume successfully. Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c956ca11-0db1-41ff-9962-e8f459546a78 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-8772a958-b2e9-4079-b7c5-ab828ad7f17a-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:40 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 Apr 29 19:11:40 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "cinder-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:40 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.880s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.manager [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Deleted volume successfully. Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d0b8e356-a06d-43c4-ae76-23e805b0cb33 req-9ae4038c-dd64-4726-815e-7c7352b9e724 tempest-ServerBootFromVolumeStableRescueTest-271307905 None] Lock "cinder-71158f3a-ebd2-4bae-b421-4cd7f5a22198-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "cinder-quobyte-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-quobyte-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8" acquired by "delete_volume" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:40 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.250s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Deleted volume successfully. Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0be032-ce05-4470-9a89-b465ab1ecdbd]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4b219493-9f3b-48d6-b21d-637150accf15 tempest-VolumesListAdminTestJSON-1681795155 None] Lock "cinder-b72dbd4c-1045-424f-8938-f81789059ad7-delete_volume" released by "delete_volume" :: held 4.172s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:40 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 Apr 29 19:11:40 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Flow 'volume_create_manager' (5ecd1aa7-678d-4422-8786-5ccf5a429286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad619f25-db97-497f-a3dc-1443ac1193c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad619f25-db97-497f-a3dc-1443ac1193c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1443091513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c676778-dec6-4169-be8a-90e79d07b237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5084a927414fd68bcc315459720a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:41Z,use_quota=True,user_id='12508e2653b249aeacdda8ebfadca3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:41 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c1bbb3-3d06-4d25-9d37-47d25c264872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c1bbb3-3d06-4d25-9d37-47d25c264872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcd8645-f346-49f4-b873-74a72fd36b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcd8645-f346-49f4-b873-74a72fd36b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c676778-dec6-4169-be8a-90e79d07b237', 'volume_name': 'volume-4c676778-dec6-4169-be8a-90e79d07b237', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c830d3-5d3a-4aba-9c8c-284719c2a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c830d3-5d3a-4aba-9c8c-284719c2a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151072c7-8234-4d19-99c3-157f2b698a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:41 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Volume 4c676778-dec6-4169-be8a-90e79d07b237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c676778-dec6-4169-be8a-90e79d07b237', 'volume_size': 1} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1443091513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c676778-dec6-4169-be8a-90e79d07b237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd5084a927414fd68bcc315459720a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:41Z,use_quota=True,user_id='12508e2653b249aeacdda8ebfadca3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Creating volume 4c676778-dec6-4169-be8a-90e79d07b237 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:41 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" returned: 0 in 1.215s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:41 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 1073741824 Apr 29 19:11:41 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:41 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260 Apr 29 19:11:41 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:41 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8" returned: 0 in 0.880s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:41 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8 Apr 29 19:11:41 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:41 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" returned: 0 in 0.673s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-ac69ea0c-b46d-4c96-bbb8-31bc34f35260" released by "delete_volume" :: held 1.982s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Created reservations ['6a99c9dd-922b-457a-9e73-0c58884eec8d', 'afdc111a-0dbd-47fe-9f5d-bb0ee64a84be', 'c85f2e4d-aa0e-431b-ac58-e05df2a8164c', 'a61e4cc7-f2dd-451b-a35a-76bce069aa14'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:42 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 1073741824" returned: 0 in 1.053s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:42 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:42 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:42 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8" returned: 0 in 0.885s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:42 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 Apr 29 19:11:42 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-quobyte-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8" released by "delete_volume" :: held 1.847s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Created reservations ['34e5998b-fe58-4984-8efc-af2838b6d133', 'e4f08a39-c2e2-4892-8f1a-8a59847f1ad7', 'b67d0038-110e-4fb7-834a-8935580d696a', '7effe689-0ff1-4890-862b-44ad1dd386b1'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:42 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:42 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "cinder-c728cb24-e79f-41ff-bf68-f5e77389f3bd-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-c728cb24-e79f-41ff-bf68-f5e77389f3bd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "cinder-quobyte-c728cb24-e79f-41ff-bf68-f5e77389f3bd" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-quobyte-c728cb24-e79f-41ff-bf68-f5e77389f3bd" acquired by "delete_volume" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78d2afa-1e2b-474b-bf4a-14099272e8a7]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:43 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237" returned: 0 in 0.781s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151072c7-8234-4d19-99c3-157f2b698a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c676778-dec6-4169-be8a-90e79d07b237', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2694c9cc-5b2a-4028-af09-8375f7372176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:43 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Volume volume-4c676778-dec6-4169-be8a-90e79d07b237 (4c676778-dec6-4169-be8a-90e79d07b237): created successfully Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2694c9cc-5b2a-4028-af09-8375f7372176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Flow 'volume_create_manager' (5ecd1aa7-678d-4422-8786-5ccf5a429286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:43 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b52b1514-0ab2-4c0f-b0c2-943a6c2156ff tempest-ServersNegativeTestJSON-1569066157 None] Created volume successfully. Apr 29 19:11:43 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd Apr 29 19:11:43 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:43 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.072s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:43 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Deleted volume successfully. Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b09c74fa-414d-4046-8135-5ecd179b7294 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-ac69ea0c-b46d-4c96-bbb8-31bc34f35260-delete_volume" released by "delete_volume" :: held 8.094s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-456ee63c-c1e9-4d91-ae31-80a8536578ea-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:43 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.902s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:43 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Deleted volume successfully. Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-456ee63c-c1e9-4d91-ae31-80a8536578ea-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-142eb04b-9d8c-40a8-bcc1-a63c544d59a1 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-9a1c7696-e56a-4a74-a29a-be1e9e0a07b8-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "cinder-quobyte-456ee63c-c1e9-4d91-ae31-80a8536578ea" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-456ee63c-c1e9-4d91-ae31-80a8536578ea" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbde7f5-de4b-4b35-b7f5-afb292d41da3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:43 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea Apr 29 19:11:43 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "cinder-4c676778-dec6-4169-be8a-90e79d07b237-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Lock "cinder-4c676778-dec6-4169-be8a-90e79d07b237-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "cinder-quobyte-4c676778-dec6-4169-be8a-90e79d07b237" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Lock "cinder-quobyte-4c676778-dec6-4169-be8a-90e79d07b237" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4dda1a-16a4-44c8-a199-5abfc5c0116f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:44 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd" returned: 0 in 1.132s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:44 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd Apr 29 19:11:44 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:44 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 Apr 29 19:11:44 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:44 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea" returned: 0 in 1.063s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:44 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea Apr 29 19:11:44 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:44 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c728cb24-e79f-41ff-bf68-f5e77389f3bd" returned: 0 in 0.717s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:44 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237" returned: 0 in 0.823s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-quobyte-c728cb24-e79f-41ff-bf68-f5e77389f3bd" released by "delete_volume" :: held 1.907s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:44 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237 Apr 29 19:11:44 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Created reservations ['d1298309-ed17-4955-ac64-d4e8e76fa509', '193f0bb9-0887-40fa-af2b-44609eb8175a', '6a9479d6-9ee9-45a3-a260-de5ff6adddcd', '3d4a1f7e-ea51-424c-a0a7-4bf3f4e5719e'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:45 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:45 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:45 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-456ee63c-c1e9-4d91-ae31-80a8536578ea" returned: 0 in 0.692s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-quobyte-456ee63c-c1e9-4d91-ae31-80a8536578ea" released by "delete_volume" :: held 1.854s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Created reservations ['fb41f349-4de3-493c-8e68-444ca972e9a9', '766fef18-7f82-4fb2-b3a7-0d2ac9f3d156', '836dfa96-e186-4b4e-8c0a-6e7e76c3b986', '557d872f-475d-4599-ab27-8b06e1309618'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:45 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4c676778-dec6-4169-be8a-90e79d07b237" returned: 0 in 0.754s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:45 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:45 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Lock "cinder-quobyte-4c676778-dec6-4169-be8a-90e79d07b237" released by "delete_volume" :: held 1.656s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Created reservations ['f025266f-4879-4342-8b10-9d3cf45f4b27', '83be5f41-96a2-49fe-be3a-03e75a628f9b', '0853ab63-c460-4997-bdf6-b93d6a4a9088', '9a6bad1a-7ab1-43a8-a79c-a88b7e7c4d46'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:45 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:45 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:46 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.983s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:46 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Deleted volume successfully. Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bf900f5e-4328-45d3-8c4e-cee6c5ec0ce4 tempest-VolumesListAdminTestJSON-966378983 None] Lock "cinder-c728cb24-e79f-41ff-bf68-f5e77389f3bd-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "cinder-dc6ae5c3-9f5b-441f-8948-93367390198d-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Lock "cinder-dc6ae5c3-9f5b-441f-8948-93367390198d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "cinder-quobyte-dc6ae5c3-9f5b-441f-8948-93367390198d" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Lock "cinder-quobyte-dc6ae5c3-9f5b-441f-8948-93367390198d" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a8e0db-de66-4b97-ac27-3ec582fe148e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:46 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.886s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:46 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Deleted volume successfully. Apr 29 19:11:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7cb7e5a9-2b62-4dc2-a767-6ef9dba6b9e9 tempest-VolumesDeleteCascade-965252427 None] Lock "cinder-456ee63c-c1e9-4d91-ae31-80a8536578ea-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:46 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d Apr 29 19:11:46 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:47 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.153s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:47 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:47 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Deleted volume successfully. Apr 29 19:11:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5810b4a7-ea6d-43ae-8b91-36c3769a47ef tempest-ServersNegativeTestJSON-1569066157 None] Lock "cinder-4c676778-dec6-4169-be8a-90e79d07b237-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:47 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d" returned: 0 in 0.940s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:47 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d Apr 29 19:11:47 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:48 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc6ae5c3-9f5b-441f-8948-93367390198d" returned: 0 in 0.699s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Lock "cinder-quobyte-dc6ae5c3-9f5b-441f-8948-93367390198d" released by "delete_volume" :: held 1.707s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Created reservations ['1b6cdf1d-f377-4eb9-adf1-1f8623ab8777', '4af71e63-6170-424c-8f60-870ae5e108bb', '140389ba-6f7b-46e4-9273-adc34b77a024', '4bf6aa5e-cbcd-466d-a580-1cd76e0e49e5'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:48 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:11:48 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:49 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.915s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:49 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:11:49 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Deleted volume successfully. Apr 29 19:11:49 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8b657063-1591-4ff4-aca4-8b2d67625d8d tempest-ServersNegativeTestJSON-1569066157 None] Lock "cinder-dc6ae5c3-9f5b-441f-8948-93367390198d-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:11:54 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Flow 'volume_create_manager' (efb13052-b4c8-4212-b768-e28b9d06ca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a389bc-3315-41bf-ab80-5a2b2737ecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a389bc-3315-41bf-ab80-5a2b2737ecd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1430123920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6cb73f-5d48-43eb-865c-78cc500de4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5805ffc4343d991f04852ab056aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:55Z,use_quota=True,user_id='df7c72032c014f37949e50655810358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6595d67b-7a9a-43da-9ccc-c597d82613ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6595d67b-7a9a-43da-9ccc-c597d82613ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5b3524-d2ce-4bde-b6e6-132c5bca6b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.image.glance [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Creating Keystone auth plugin from conf {{(pid=84523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5b3524-d2ce-4bde-b6e6-132c5bca6b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a6cb73f-5d48-43eb-865c-78cc500de4bb', 'volume_name': 'volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c77d49-bee2-4b6e-998b-397c19509322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c77d49-bee2-4b6e-998b-397c19509322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1298c8e5-6545-46ea-8b3e-90d5e86e8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:11:55 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Volume 7a6cb73f-5d48-43eb-865c-78cc500de4bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Trying to clone 7a6cb73f-5d48-43eb-865c-78cc500de4bb from image f7bc816f-25b0-408e-baa1-85adebe218d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]). {{(pid=84523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 19:11:55 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Image download 20.69 MB at 20.69 MB/s Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8539ed-da20-4612-a8be-b62573fefdda]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:56 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD Apr 29 19:11:56 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:56 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:56 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Temporary image f7bc816f-25b0-408e-baa1-85adebe218d0 is fetched for user df7c72032c014f37949e50655810358d. {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 19:11:56 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c53cea2-9faf-450b-9ce1-fc5a3bdfc928]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:56 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD Apr 29 19:11:56 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:57 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD" returned: 0 in 0.857s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1430123920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6cb73f-5d48-43eb-865c-78cc500de4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5805ffc4343d991f04852ab056aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:11:55Z,use_quota=True,user_id='df7c72032c014f37949e50655810358d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Creating volume 7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:11:57 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:11:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:57 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb 1073741824 Apr 29 19:11:57 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:58 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb 1073741824" returned: 0 in 1.029s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:58 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb Apr 29 19:11:58 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:11:59 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 29 19:11:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb" returned: 0 in 0.675s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:11:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:11:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:11:59 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Attempting download of f7bc816f-25b0-408e-baa1-85adebe218d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}])) to volume 7a6cb73f-5d48-43eb-865c-78cc500de4bb. {{(pid=84523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 29 19:11:59 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f4b8e7-b004-455d-9e77-b2cf860a707f]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:11:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_ml2hejyg {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:11:59 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_ml2hejyg Apr 29 19:11:59 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:00 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_ml2hejyg" returned: 0 in 0.716s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_ml2hejyg {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:00 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_ml2hejyg Apr 29 19:12:00 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:01 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_ml2hejyg" returned: 1 in 0.733s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_ml2hejyg' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:12:01 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f50b8f6-d65b-44e7-ad5a-d74803684f71]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:01 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD Apr 29 19:12:01 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:01 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD" returned: 0 in 0.838s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:01 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] f7bc816f-25b0-408e-baa1-85adebe218d0 was qcow2, converting to raw {{(pid=84523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 19:12:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:01 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb Apr 29 19:12:01 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (5f843e47-b2d4-4393-86c3-9b3e7f92f1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297dbf44-bd20-4bea-aa66-de0ce06aa5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297dbf44-bd20-4bea-aa66-de0ce06aa5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1807919676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7e017d1e8144b2ac5fe27ac7160a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:04Z,use_quota=True,user_id='465b9b09a1f64173b199399eb8a0889a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e887c419-e6a2-4dcb-996c-f0c25ae68382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e887c419-e6a2-4dcb-996c-f0c25ae68382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4e8df6-be5c-43a4-8760-0cc9501e4ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4e8df6-be5c-43a4-8760-0cc9501e4ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9', 'volume_name': 'volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7cf0bf-1726-4e3c-8e63-21560ae8b37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7cf0bf-1726-4e3c-8e63-21560ae8b37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb739166-776c-446c-b26f-49d79614b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:03 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Volume 5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9', 'volume_size': 1} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1807919676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7e017d1e8144b2ac5fe27ac7160a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:04Z,use_quota=True,user_id='465b9b09a1f64173b199399eb8a0889a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Creating volume 5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:12:03 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:12:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:03 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 1073741824 Apr 29 19:12:03 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:04 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb" returned: 0 in 2.629s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:04 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_aok_s98ddevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:12:04 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Converted 112.00 MB image at 42.56 MB/s Apr 29 19:12:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:04 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb 1G Apr 29 19:12:04 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:04 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 1073741824" returned: 0 in 1.168s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:05 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 Apr 29 19:12:05 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:05 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb 1G" returned: 0 in 0.821s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[42de1997-491a-4b88-a5b0-8b2f14ff8d5f]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:05 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb Apr 29 19:12:05 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:05 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" returned: 0 in 0.820s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb739166-776c-446c-b26f-49d79614b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0877aed-8588-4083-8dc9-ed993264d8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:05 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Volume volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 (5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9): created successfully Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0877aed-8588-4083-8dc9-ed993264d8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (5f843e47-b2d4-4393-86c3-9b3e7f92f1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:05 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5187000a-ca4e-4660-9f05-41de98cb871e tempest-VolumesSnapshotTestJSON-938417878 None] Created volume successfully. Apr 29 19:12:06 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb" returned: 0 in 0.841s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:06 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb Apr 29 19:12:06 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:07 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb" returned: 1 in 1.045s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Downloaded image f7bc816f-25b0-408e-baa1-85adebe218d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}])) to volume 7a6cb73f-5d48-43eb-865c-78cc500de4bb successfully. {{(pid=84523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Temporary image f7bc816f-25b0-408e-baa1-85adebe218d0 for user df7c72032c014f37949e50655810358d is deleted. {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Marking volume 7a6cb73f-5d48-43eb-865c-78cc500de4bb as bootable. {{(pid=84523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Creating offline snapshot c798e57b-5957-4c92-b548-506bdd11e03c of volume 5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Copying metadata from image f7bc816f-25b0-408e-baa1-85adebe218d0 to 7a6cb73f-5d48-43eb-865c-78cc500de4bb. {{(pid=84523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Creating volume glance metadata for volume 7a6cb73f-5d48-43eb-865c-78cc500de4bb backed by image f7bc816f-25b0-408e-baa1-85adebe218d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdae76de-b101-42ee-a3b7-2a5cf58009c7]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1298c8e5-6545-46ea-8b3e-90d5e86e8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347fb9ca-46de-4cf2-8a8d-206796e1ad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:07 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Volume volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb (7a6cb73f-5d48-43eb-865c-78cc500de4bb): created successfully Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347fb9ca-46de-4cf2-8a8d-206796e1ad96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Flow 'volume_create_manager' (efb13052-b4c8-4212-b768-e28b9d06ca9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-dcc48713-405d-4377-a234-3a0c91637704 tempest-VolumesImageMetadata-1637420827 None] Created volume successfully. Apr 29 19:12:07 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 Apr 29 19:12:07 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:08 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" returned: 0 in 0.964s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:08 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c 1G Apr 29 19:12:08 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Acquiring lock "cinder-7a6cb73f-5d48-43eb-865c-78cc500de4bb-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Lock "cinder-7a6cb73f-5d48-43eb-865c-78cc500de4bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Acquiring lock "cinder-quobyte-7a6cb73f-5d48-43eb-865c-78cc500de4bb" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Lock "cinder-quobyte-7a6cb73f-5d48-43eb-865c-78cc500de4bb" acquired by "delete_volume" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:08 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9253a9-6bd3-4bd2-b0cc-f7c673678522]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:08 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb Apr 29 19:12:08 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:09 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c 1G" returned: 0 in 1.084s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:09 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c Apr 29 19:12:09 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:09 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb" returned: 0 in 0.911s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:09 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb Apr 29 19:12:09 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=94,cinder:INSERT=34,cinder:UPDATE=146,cinder:DELETE=11 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Flow 'volume_create_manager' (110b1e8e-fee3-4d6b-8050-3ca3a42b0fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44663498-1c85-44df-a5c6-ea6baeafb878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44663498-1c85-44df-a5c6-ea6baeafb878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-799007099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702cabf1-9a51-4cb3-8d3c-08450cd8893d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1001dcb1204e478245ec75c1b778f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:10Z,use_quota=True,user_id='10e213c5d089471c88f3894719e57d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb30c62-7a83-48be-b535-34cb0d3d96c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb30c62-7a83-48be-b535-34cb0d3d96c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733b9676-1c80-49e2-bf9a-d99e7ae34ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733b9676-1c80-49e2-bf9a-d99e7ae34ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702cabf1-9a51-4cb3-8d3c-08450cd8893d', 'volume_name': 'volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e857bff-5c04-4591-b838-10433c61bc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e857bff-5c04-4591-b838-10433c61bc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede5df48-9c11-4f97-afa7-d23b8ec95dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:10 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Volume 702cabf1-9a51-4cb3-8d3c-08450cd8893d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d', 'volume_size': 1} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:10 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c" returned: 0 in 0.872s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:10 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c is being set with open permissions: ugo+rw Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:10 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c Apr 29 19:12:10 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:10 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb" returned: 1 in 0.880s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:10 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb Apr 29 19:12:10 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:10 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c" returned: 0 in 0.641s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:10 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.info Apr 29 19:12:10 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:11 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7a6cb73f-5d48-43eb-865c-78cc500de4bb" returned: 0 in 0.605s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Lock "cinder-quobyte-7a6cb73f-5d48-43eb-865c-78cc500de4bb" released by "delete_volume" :: held 2.519s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Created reservations ['729ada65-f496-4cc5-8dab-a39cae6c4367', '1b0800c7-a778-409c-823e-68b0e3171d03', 'f0bd3a7e-d247-49a4-bead-9bd0ad91a671', '3720d996-1ae9-4384-bcc3-0cf625b5dbe0'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:11 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:12:11 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:11 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.info" returned: 0 in 0.842s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:11 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.info is being set with open permissions: ugo+rw Apr 29 19:12:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:11 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.info Apr 29 19:12:11 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:12 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.785s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:12:12 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Deleted volume successfully. Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8d3bba4-2d34-4bef-ad99-c7382124fa60 tempest-VolumesImageMetadata-1637420827 None] Lock "cinder-7a6cb73f-5d48-43eb-865c-78cc500de4bb-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:12 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.info" returned: 0 in 0.815s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.340s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.431s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-799007099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702cabf1-9a51-4cb3-8d3c-08450cd8893d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1001dcb1204e478245ec75c1b778f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:10Z,use_quota=True,user_id='10e213c5d089471c88f3894719e57d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Creating volume 702cabf1-9a51-4cb3-8d3c-08450cd8893d {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:12:12 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:12:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:12 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d 1073741824 Apr 29 19:12:12 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:12 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-05c15bf8-2c4a-4022-b406-61ff20475059 tempest-VolumesSnapshotTestJSON-938417878 None] Create snapshot completed successfully Apr 29 19:12:13 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d 1073741824" returned: 0 in 1.116s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:13 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d Apr 29 19:12:13 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-c798e57b-5957-4c92-b548-506bdd11e03c-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-c798e57b-5957-4c92-b548-506bdd11e03c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-c798e57b-5957-4c92-b548-506bdd11e03c" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-c798e57b-5957-4c92-b548-506bdd11e03c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Deleting offline snapshot c798e57b-5957-4c92-b548-506bdd11e03c of volume 5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] snapshot_file for this snap is: volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f027ab4-8a1b-478e-aeae-405f89980fd9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:14 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c Apr 29 19:12:14 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:14 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d" returned: 0 in 1.029s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede5df48-9c11-4f97-afa7-d23b8ec95dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50689d39-4d74-4a49-b251-764de7648bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:14 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Volume volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d (702cabf1-9a51-4cb3-8d3c-08450cd8893d): created successfully Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50689d39-4d74-4a49-b251-764de7648bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Flow 'volume_create_manager' (110b1e8e-fee3-4d6b-8050-3ca3a42b0fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:14 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-ead6ccc9-9166-4bb2-b657-643cab26a76c req-4a7bf231-c774-40bd-92e6-1b5440770540 tempest-VolumesSnapshotsTestJSON-1412517991 None] Created volume successfully. Apr 29 19:12:15 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c" returned: 0 in 0.953s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[41722d05-f2e9-4dbb-b209-ca87397e0eed]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:15 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 Apr 29 19:12:15 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Flow 'volume_create_manager' (92e60026-a071-4e98-bdef-04c7b8de4d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338a45b9-9e4b-4964-962c-ec2cd54b7538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:15 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338a45b9-9e4b-4964-962c-ec2cd54b7538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1806824652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e6ef1a-d80e-48ec-8c24-18dc827e66d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf7dfd5a2d04dd4a9ca17613634e257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:16Z,use_quota=True,user_id='b45bace84f1148f0818684cbd7159394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a7e02a-6755-4864-b05e-460502161a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a7e02a-6755-4864-b05e-460502161a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263b7152-8c36-4cf8-adca-d43d8bcb0e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263b7152-8c36-4cf8-adca-d43d8bcb0e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e6ef1a-d80e-48ec-8c24-18dc827e66d8', 'volume_name': 'volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b563c0d-1c96-40d2-94ed-29207a67b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b563c0d-1c96-40d2-94ed-29207a67b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d43fdd2-aac8-44ea-8bae-a0d90608ce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:15 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Volume f0e6ef1a-d80e-48ec-8c24-18dc827e66d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8', 'volume_size': 1} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1806824652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e6ef1a-d80e-48ec-8c24-18dc827e66d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faf7dfd5a2d04dd4a9ca17613634e257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:16Z,use_quota=True,user_id='b45bace84f1148f0818684cbd7159394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Creating volume f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:12:15 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" returned: 0 in 0.857s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:16 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c Apr 29 19:12:16 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:16 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 1073741824 Apr 29 19:12:16 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:16 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c" returned: 0 in 0.794s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:16 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c Apr 29 19:12:16 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:16 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 1073741824" returned: 0 in 0.930s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:16 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 Apr 29 19:12:16 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:17 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9.c798e57b-5957-4c92-b548-506bdd11e03c" returned: 0 in 0.656s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-c798e57b-5957-4c92-b548-506bdd11e03c" released by "_delete_snapshot" :: held 3.417s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" released by "delete_snapshot" :: held 3.449s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:17 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Created reservations ['40b96e1f-532a-4e4c-8921-a0ff9b78f6ad', '2e6179fe-08bf-446e-ab52-1eef5c822e41', '89f76a19-2570-4e98-a30c-911be6e929f3', '22809f4d-f659-4697-b5ea-4e06509ff673'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" returned: 0 in 0.607s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.322s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Creating offline snapshot ef2c6fec-e129-42c4-a267-001e2eab3cfd of volume 702cabf1-9a51-4cb3-8d3c-08450cd8893d {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d43fdd2-aac8-44ea-8bae-a0d90608ce66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366ec86c-601f-416b-b946-7710fe8a1ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd08eb6-fc33-4b2d-a83e-fcf82db65ae0]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:17 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Volume volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 (f0e6ef1a-d80e-48ec-8c24-18dc827e66d8): created successfully Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366ec86c-601f-416b-b946-7710fe8a1ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Flow 'volume_create_manager' (92e60026-a071-4e98-bdef-04c7b8de4d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-596b3e20-bcb8-4a88-b4ed-6b3f3e13b374 tempest-SnapshotMetadataTestJSON-648717337 None] Created volume successfully. Apr 29 19:12:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Delete snapshot completed successfully. Apr 29 19:12:17 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bb07538-ee6a-44ab-bb45-95813b3d249b tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-c798e57b-5957-4c92-b548-506bdd11e03c-delete_snapshot" released by "delete_snapshot" :: held 3.732s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:17 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d Apr 29 19:12:17 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:18 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d" returned: 0 in 0.818s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:18 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd 1G Apr 29 19:12:18 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (4bc353c1-74e5-4aff-aad5-cb60348e9e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10d1ed2-f3ba-4667-a6f7-a80864a9d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10d1ed2-f3ba-4667-a6f7-a80864a9d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-374454913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93263abc-abb0-4572-913f-0dd025702b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7e017d1e8144b2ac5fe27ac7160a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:19Z,use_quota=True,user_id='465b9b09a1f64173b199399eb8a0889a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d7ac1e-f209-4d42-85ad-035b88200d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d7ac1e-f209-4d42-85ad-035b88200d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735c7aff-709b-4638-be44-58e4f1f4fe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735c7aff-709b-4638-be44-58e4f1f4fe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93263abc-abb0-4572-913f-0dd025702b0c', 'volume_name': 'volume-93263abc-abb0-4572-913f-0dd025702b0c', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15afcff4-907d-454f-9b5c-c4ab0f43572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15afcff4-907d-454f-9b5c-c4ab0f43572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98816ff8-073c-41df-ac60-28c9a11145a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:18 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Volume 93263abc-abb0-4572-913f-0dd025702b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93263abc-abb0-4572-913f-0dd025702b0c', 'volume_size': 1} Apr 29 19:12:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:19 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd 1G" returned: 0 in 0.993s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:19 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd Apr 29 19:12:19 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:20 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd" returned: 0 in 0.658s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:20 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd is being set with open permissions: ugo+rw Apr 29 19:12:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:20 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd Apr 29 19:12:20 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:20 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd" returned: 0 in 0.635s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:20 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.info Apr 29 19:12:20 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:21 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.info" returned: 0 in 0.710s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:21 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.info is being set with open permissions: ugo+rw Apr 29 19:12:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:21 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.info Apr 29 19:12:21 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:22 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.info" returned: 0 in 0.689s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.621s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.949s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Creating offline snapshot 24115828-fe09-453e-be73-311699ad8cac of volume f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:12:22 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e6607c-537e-4fb4-acfa-14293f6d0b39]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:22 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-7e253b4b-92d7-4ed4-a43a-26bb2fd9fa94 req-9dc99003-0c85-4c36-9690-063f234de9ef tempest-VolumesSnapshotsTestJSON-1412517991 None] Create snapshot completed successfully Apr 29 19:12:22 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 Apr 29 19:12:22 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "cinder-ef2c6fec-e129-42c4-a267-001e2eab3cfd-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-ef2c6fec-e129-42c4-a267-001e2eab3cfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "cinder-quobyte-702cabf1-9a51-4cb3-8d3c-08450cd8893d" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-quobyte-702cabf1-9a51-4cb3-8d3c-08450cd8893d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "cinder-quobyte-ef2c6fec-e129-42c4-a267-001e2eab3cfd" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-quobyte-ef2c6fec-e129-42c4-a267-001e2eab3cfd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Deleting offline snapshot ef2c6fec-e129-42c4-a267-001e2eab3cfd of volume 702cabf1-9a51-4cb3-8d3c-08450cd8893d {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:12:23 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] snapshot_file for this snap is: volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" returned: 0 in 0.979s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9030911a-0afd-4772-882c-3676adbc4aa2]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:23 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac 1G Apr 29 19:12:23 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:23 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd Apr 29 19:12:23 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:23 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd" returned: 0 in 0.786s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:12:24 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:24 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2163844-b812-4d76-8c51-aa1a0807e8ca]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac 1G" returned: 0 in 0.846s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:24 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac Apr 29 19:12:24 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:24 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d Apr 29 19:12:24 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:24 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac" returned: 0 in 0.700s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:24 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac is being set with open permissions: ugo+rw Apr 29 19:12:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:24 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac Apr 29 19:12:24 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:24 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d" returned: 0 in 0.774s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:24 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd Apr 29 19:12:24 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:25 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac" returned: 0 in 0.628s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:25 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.info Apr 29 19:12:25 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:25 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd" returned: 0 in 0.968s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:25 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd Apr 29 19:12:25 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:26 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.info" returned: 0 in 1.099s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:26 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.info is being set with open permissions: ugo+rw Apr 29 19:12:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:26 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.info Apr 29 19:12:26 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:26 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d.ef2c6fec-e129-42c4-a267-001e2eab3cfd" returned: 0 in 1.015s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-quobyte-ef2c6fec-e129-42c4-a267-001e2eab3cfd" released by "_delete_snapshot" :: held 3.689s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-quobyte-702cabf1-9a51-4cb3-8d3c-08450cd8893d" released by "delete_snapshot" :: held 3.719s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:26 devstack cinder-volume[84523]: DEBUG cinder.quota [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Created reservations ['694372c6-7b09-4453-91e4-b87e40ba09a1', '3b9d0e54-17ee-458f-acb2-838fbabedc19', 'ca03509a-2139-4c22-b072-7f0bae0f4de9', '07def544-706c-45b5-8bc9-bd10eff1e692'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:12:27 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Delete snapshot completed successfully. Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-d3d34ec5-93b3-4e2e-adf8-c29a3d428086 req-8c972136-e939-4331-aded-8a499cd6656e tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-ef2c6fec-e129-42c4-a267-001e2eab3cfd-delete_snapshot" released by "delete_snapshot" :: held 3.944s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.info" returned: 0 in 0.696s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:27 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.072s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.324s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-374454913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93263abc-abb0-4572-913f-0dd025702b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7e017d1e8144b2ac5fe27ac7160a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:19Z,use_quota=True,user_id='465b9b09a1f64173b199399eb8a0889a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Creating volume 93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:12:27 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:27 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c 1073741824 Apr 29 19:12:27 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:27 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9feb20f5-f09a-477c-ad2a-cc3374ebfe18 tempest-SnapshotMetadataTestJSON-648717337 None] Create snapshot completed successfully Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "cinder-702cabf1-9a51-4cb3-8d3c-08450cd8893d-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-702cabf1-9a51-4cb3-8d3c-08450cd8893d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "cinder-quobyte-702cabf1-9a51-4cb3-8d3c-08450cd8893d" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-quobyte-702cabf1-9a51-4cb3-8d3c-08450cd8893d" acquired by "delete_volume" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc499bbc-c8f5-4e90-9dfd-407ba78e2841]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:27 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d Apr 29 19:12:27 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:29 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c 1073741824" returned: 0 in 1.788s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:29 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c Apr 29 19:12:29 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "cinder-24115828-fe09-453e-be73-311699ad8cac-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:29 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d" returned: 0 in 1.876s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-24115828-fe09-453e-be73-311699ad8cac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "cinder-quobyte-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:29 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d Apr 29 19:12:29 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-quobyte-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" acquired by "delete_snapshot" :: waited 0.081s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "cinder-quobyte-24115828-fe09-453e-be73-311699ad8cac" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:29 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:12:29 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-quobyte-24115828-fe09-453e-be73-311699ad8cac" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Deleting offline snapshot 24115828-fe09-453e-be73-311699ad8cac of volume f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] snapshot_file for this snap is: volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde74488-e745-4792-bdc3-fa3702944369]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:30 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac Apr 29 19:12:30 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:30 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c" returned: 0 in 1.358s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] <== create_volume: return (3254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:12:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.257s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98816ff8-073c-41df-ac60-28c9a11145a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93263abc-abb0-4572-913f-0dd025702b0c', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab16895-d3c2-4245-a335-91f8b93183f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:30 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Volume volume-93263abc-abb0-4572-913f-0dd025702b0c (93263abc-abb0-4572-913f-0dd025702b0c): created successfully Apr 29 19:12:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab16895-d3c2-4245-a335-91f8b93183f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (4bc353c1-74e5-4aff-aad5-cb60348e9e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:30 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-90a11265-b21c-4116-867e-da8d215c10bb tempest-VolumesSnapshotTestJSON-938417878 None] Created volume successfully. Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:31 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.537s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Creating offline snapshot 78c966da-3d78-4918-a0de-aea3e454db59 of volume 93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd3f50-41c9-4dcf-8349-118134ee8f7f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:31 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-702cabf1-9a51-4cb3-8d3c-08450cd8893d" returned: 0 in 1.739s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-quobyte-702cabf1-9a51-4cb3-8d3c-08450cd8893d" released by "delete_volume" :: held 3.732s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG cinder.quota [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Created reservations ['f71f11c0-4a82-4092-9d49-59890e831064', '9da40b08-8324-453a-aeef-97ef37902340', 'b2efb0a3-8761-41bb-a677-65feaaefc8d3', '1f2ca426-ebb5-4d3b-8faf-7474a03ee596'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:12:31 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c Apr 29 19:12:31 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:31 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac" returned: 0 in 1.814s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bdd243-e366-433f-99e9-837a5738c56c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:31 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:12:31 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:32 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 Apr 29 19:12:32 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:32 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.085s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:32 devstack cinder-volume[84523]: DEBUG cinder.manager [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:12:32 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Deleted volume successfully. Apr 29 19:12:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-fad40bde-e3f1-43fd-ac2c-a9ee0ae91d46 req-1938e001-3acd-4dbb-a1f9-c82e14e7d883 tempest-VolumesSnapshotsTestJSON-1412517991 None] Lock "cinder-702cabf1-9a51-4cb3-8d3c-08450cd8893d-delete_volume" released by "delete_volume" :: held 5.253s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:33 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c" returned: 0 in 1.723s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:33 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 1G Apr 29 19:12:33 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:33 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" returned: 0 in 1.752s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:33 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac Apr 29 19:12:33 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:34 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:34 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 1G" returned: 0 in 1.459s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93263abc-abb0-4572-913f-0dd025702b0c -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac" returned: 0 in 1.060s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:34 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93263abc-abb0-4572-913f-0dd025702b0c -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 Apr 29 19:12:34 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:34 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac Apr 29 19:12:34 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:35 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8.24115828-fe09-453e-be73-311699ad8cac" returned: 0 in 1.399s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-quobyte-24115828-fe09-453e-be73-311699ad8cac" released by "_delete_snapshot" :: held 6.314s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-quobyte-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" released by "delete_snapshot" :: held 6.372s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:36 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:DELETE=13,cinder:UPDATE=120,cinder:SELECT=109,cinder:INSERT=42 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:12:36 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Created reservations ['1265fa15-f64c-44ae-801e-1a6c6e524f81', '5aef9903-b63e-46f1-b8e9-0253b5ba0645', 'd9e7640b-cbd4-470a-9cd1-16bd28cecbd5', '97b90c72-16f4-4e63-a15b-e6efe4ba9a47'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:12:36 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93263abc-abb0-4572-913f-0dd025702b0c -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59" returned: 0 in 1.870s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:36 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 is being set with open permissions: ugo+rw Apr 29 19:12:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:36 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 Apr 29 19:12:36 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Delete snapshot completed successfully. Apr 29 19:12:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1b7b9a74-0233-4f49-a00f-328a2cc89a4c tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-24115828-fe09-453e-be73-311699ad8cac-delete_snapshot" released by "delete_snapshot" :: held 6.800s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:37 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59" returned: 0 in 1.237s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "cinder-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:37 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.info Apr 29 19:12:37 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "cinder-quobyte-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-quobyte-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" acquired by "delete_volume" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:38 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d7364-25d8-4e41-916d-934a74b42f4f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:38 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 Apr 29 19:12:38 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:38 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.info" returned: 0 in 1.150s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:38 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.info is being set with open permissions: ugo+rw Apr 29 19:12:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:38 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.info Apr 29 19:12:38 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:39 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" returned: 0 in 1.026s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:39 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8 Apr 29 19:12:39 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:39 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.info" returned: 0 in 0.713s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.370s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:39 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-309875f6-ab9a-47ca-8e5a-f72af28b4ac6 tempest-VolumesSnapshotTestJSON-938417878 None] Create snapshot completed successfully Apr 29 19:12:39 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" returned: 0 in 0.756s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-quobyte-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8" released by "delete_volume" :: held 1.906s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Created reservations ['d9ab62d9-c8de-4624-bf27-9bba1f213ab6', '19d5a06c-7713-4a49-83a9-d8b2a3d36f8e', '7de65965-3fa0-4db6-8adf-3f3cd9758761', 'f44225ec-86e5-44cb-a8ad-543a59c78c25'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:40 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:12:40 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Flow 'volume_create_manager' (05bc073a-1562-4499-b4e5-df69c2f2149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04681ddc-b4ca-40c2-8d2d-b189b0f971e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04681ddc-b4ca-40c2-8d2d-b189b0f971e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-298841840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea74de63-1c7b-4334-8b4e-a1681e9c0f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80810f6bcca34cb2acfb0b97da24d80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:41Z,use_quota=True,user_id='cfb1b4fe4f234113ac0f7effe8597d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eef3050-1923-4daf-a468-9ff3c9e05dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eef3050-1923-4daf-a468-9ff3c9e05dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7e06c9-6214-4879-b275-d2c169a382b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7e06c9-6214-4879-b275-d2c169a382b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea74de63-1c7b-4334-8b4e-a1681e9c0f04', 'volume_name': 'volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1255a1f-da30-4c4e-b16d-a2de2bb0003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1255a1f-da30-4c4e-b16d-a2de2bb0003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7eba22-e342-4e5b-b04c-ee3b810d5119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:40 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04', 'volume_size': 1} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-298841840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea74de63-1c7b-4334-8b4e-a1681e9c0f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80810f6bcca34cb2acfb0b97da24d80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:41Z,use_quota=True,user_id='cfb1b4fe4f234113ac0f7effe8597d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Creating volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:12:40 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:12:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:40 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 1073741824 Apr 29 19:12:40 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:41 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.041s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:12:41 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Deleted volume successfully. Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (ca99fb50-8019-412c-ab6c-c5fa09d02ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16731555-0c50-499d-bb3c-4a8b01fbec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16731555-0c50-499d-bb3c-4a8b01fbec7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1122856136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75664f28-e874-4d03-9657-6b59e705f90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7e017d1e8144b2ac5fe27ac7160a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=78c966da-3d78-4918-a0de-aea3e454db59,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:41Z,use_quota=True,user_id='465b9b09a1f64173b199399eb8a0889a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ae54e3-ec66-41bd-8dbf-12aaf70bee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ae54e3-ec66-41bd-8dbf-12aaf70bee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed8ad6e-d8e8-4824-b159-176946585712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed8ad6e-d8e8-4824-b159-176946585712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75664f28-e874-4d03-9657-6b59e705f90e', 'volume_name': 'volume-75664f28-e874-4d03-9657-6b59e705f90e', 'volume_size': 2, 'snapshot_id': '78c966da-3d78-4918-a0de-aea3e454db59'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c26f685-8544-4f73-97f9-f383550b22cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c26f685-8544-4f73-97f9-f383550b22cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0701f102-00f1-4e8c-8f4b-17180d6ec183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:41 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Volume 75664f28-e874-4d03-9657-6b59e705f90e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75664f28-e874-4d03-9657-6b59e705f90e', 'volume_size': 2, 'snapshot_id': '78c966da-3d78-4918-a0de-aea3e454db59'} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-46b41dba-df06-4889-8947-a1268aba8c4d tempest-SnapshotMetadataTestJSON-648717337 None] Lock "cinder-f0e6ef1a-d80e-48ec-8c24-18dc827e66d8-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:41 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 1073741824" returned: 0 in 0.996s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:41 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 Apr 29 19:12:41 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:42 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" returned: 0 in 0.652s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.431s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-78c966da-3d78-4918-a0de-aea3e454db59-75664f28-e874-4d03-9657-6b59e705f90e" by "_create_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-78c966da-3d78-4918-a0de-aea3e454db59-75664f28-e874-4d03-9657-6b59e705f90e" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Creating volume 75664f28-e874-4d03-9657-6b59e705f90e from snapshot 78c966da-3d78-4918-a0de-aea3e454db59 {{(pid=84523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-75664f28-e874-4d03-9657-6b59e705f90e" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7eba22-e342-4e5b-b04c-ee3b810d5119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76775413-aceb-45de-94af-39999b57f74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:42 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Volume volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 (ea74de63-1c7b-4334-8b4e-a1681e9c0f04): created successfully Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76775413-aceb-45de-94af-39999b57f74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Flow 'volume_create_manager' (05bc073a-1562-4499-b4e5-df69c2f2149d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-75664f28-e874-4d03-9657-6b59e705f90e" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] snapshot: 78c966da-3d78-4918-a0de-aea3e454db59, volume: 75664f28-e874-4d03-9657-6b59e705f90e, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:42 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e5288802-2d7a-44cf-9073-1fbe531d3dd9 tempest-SnapshotsActionsTest-689829371 None] Created volume successfully. Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df897c8-3d64-44a4-b635-131659025ae1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:43 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 Apr 29 19:12:43 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:44 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59" returned: 0 in 1.435s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93263abc-abb0-4572-913f-0dd025702b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afdd90c-2c0c-4de7-a281-6c41af49b158]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:44 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c Apr 29 19:12:44 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Flow 'volume_create_manager' (38639da1-3602-40e3-99d7-030cc660daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff128b0-3824-41fd-8420-feb1021433e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff128b0-3824-41fd-8420-feb1021433e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-150896554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f418ef7c-e3e2-4014-8a22-18578bad0612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df2f42bc97f4906b601ac0ed10f102f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:45Z,use_quota=True,user_id='491b57b57b29492ea74a32d9947bdce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5a90ec-50b1-4851-8b9d-f29a2cdec015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5a90ec-50b1-4851-8b9d-f29a2cdec015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df68253f-3194-4fc4-9a13-b97a0f2884c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df68253f-3194-4fc4-9a13-b97a0f2884c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f418ef7c-e3e2-4014-8a22-18578bad0612', 'volume_name': 'volume-f418ef7c-e3e2-4014-8a22-18578bad0612', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceb03b7-03f3-4c4b-8bb2-075b3b14ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceb03b7-03f3-4c4b-8bb2-075b3b14ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f2107c-fc34-4876-a4c9-4a8e719a497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Volume f418ef7c-e3e2-4014-8a22-18578bad0612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f418ef7c-e3e2-4014-8a22-18578bad0612', 'volume_size': 1} Apr 29 19:12:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:45 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c" returned: 0 in 1.000s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:45 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:12:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:45 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e Apr 29 19:12:45 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Flow 'volume_create_manager' (e51aba05-f7eb-4c80-a721-0fbd774ea3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5d9fcd-e424-4c2a-9e5d-1c55b8ffbd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5d9fcd-e424-4c2a-9e5d-1c55b8ffbd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2066043319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22706d4-4ebb-4ea4-8d51-d5e532b389c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8471bea9df924d759109ad3b51275356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:46Z,use_quota=True,user_id='0ede86bae7894664b443da48303b45df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd21361b-804a-41b2-b786-3e4595bd90cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd21361b-804a-41b2-b786-3e4595bd90cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c0dfa3-6d68-413a-a1a5-6f2087acc50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c0dfa3-6d68-413a-a1a5-6f2087acc50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22706d4-4ebb-4ea4-8d51-d5e532b389c2', 'volume_name': 'volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f99122-7802-43e0-876f-ac2b8e9a1499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f99122-7802-43e0-876f-ac2b8e9a1499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df66f6f-e49b-4ec5-a6c5-b4edb5ec6e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:46 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Volume a22706d4-4ebb-4ea4-8d51-d5e532b389c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2', 'volume_size': 1} Apr 29 19:12:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:51 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e" returned: 0 in 6.602s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:51 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16f5cb6-dfdf-47f2-bb9e-f565c4de5b9d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:51 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c Apr 29 19:12:51 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:52 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c" returned: 0 in 0.891s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:52 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:12:52 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Converted 1024.00 MB image at 155.09 MB/s Apr 29 19:12:52 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e is being set with open permissions: ugo+rw Apr 29 19:12:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:52 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e Apr 29 19:12:52 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:53 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e" returned: 0 in 0.565s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-75664f28-e874-4d03-9657-6b59e705f90e" released by "_copy_volume_from_snapshot" :: held 10.636s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-78c966da-3d78-4918-a0de-aea3e454db59-75664f28-e874-4d03-9657-6b59e705f90e" released by "_create_volume_from_snapshot" :: held 10.711s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.732s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.928s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Creating offline snapshot d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0701f102-00f1-4e8c-8f4b-17180d6ec183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75664f28-e874-4d03-9657-6b59e705f90e', 'volume_size': 2, 'snapshot_id': '78c966da-3d78-4918-a0de-aea3e454db59'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fb3039-4d7e-473d-8b26-b29c1c3fe406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb54b9-b486-4dd4-b682-7af7e21c50d9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:53 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Volume volume-75664f28-e874-4d03-9657-6b59e705f90e (75664f28-e874-4d03-9657-6b59e705f90e): created successfully Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fb3039-4d7e-473d-8b26-b29c1c3fe406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (ca99fb50-8019-412c-ab6c-c5fa09d02ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-02fb198f-e74e-4555-b3c2-0f043aa5db41 tempest-VolumesSnapshotTestJSON-938417878 None] Created volume successfully. Apr 29 19:12:53 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 Apr 29 19:12:53 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:54 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" returned: 0 in 0.736s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:54 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 1G Apr 29 19:12:54 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-75664f28-e874-4d03-9657-6b59e705f90e-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-75664f28-e874-4d03-9657-6b59e705f90e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-75664f28-e874-4d03-9657-6b59e705f90e" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-75664f28-e874-4d03-9657-6b59e705f90e" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b4b731-3b30-46f8-b59c-13f3bf43107e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:54 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e Apr 29 19:12:54 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:54 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 1G" returned: 0 in 0.759s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:54 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:12:54 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:55 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e" returned: 0 in 0.798s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:55 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e Apr 29 19:12:55 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:55 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.715s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:55 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 is being set with open permissions: ugo+rw Apr 29 19:12:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:55 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:12:55 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:56 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-75664f28-e874-4d03-9657-6b59e705f90e" returned: 0 in 0.659s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-75664f28-e874-4d03-9657-6b59e705f90e" released by "delete_volume" :: held 1.504s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Created reservations ['8ed4dd76-8c54-4728-aa73-4c230d726445', 'd26670d3-98bf-4349-812e-d9e3213a6081', 'f83de6b0-f00c-441c-949c-7774dc1ce219', 'f5364f6e-59fa-4848-a4f8-47caf5d3a7c9'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:56 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.675s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:56 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:12:56 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:56 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.info Apr 29 19:12:56 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-78c966da-3d78-4918-a0de-aea3e454db59-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-78c966da-3d78-4918-a0de-aea3e454db59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-93263abc-abb0-4572-913f-0dd025702b0c" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-93263abc-abb0-4572-913f-0dd025702b0c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-78c966da-3d78-4918-a0de-aea3e454db59" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:12:57 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.info" returned: 0 in 0.742s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:57 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.info is being set with open permissions: ugo+rw Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-78c966da-3d78-4918-a0de-aea3e454db59" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:12:57 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Deleting offline snapshot 78c966da-3d78-4918-a0de-aea3e454db59 of volume 93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:12:57 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.info Apr 29 19:12:57 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] snapshot_file for this snap is: volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.865s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:12:57 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Deleted volume successfully. Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[117dee0c-6f30-411d-80b6-50bf639085c9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4d681efa-12ea-4ae4-9e7d-5108245004c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-75664f28-e874-4d03-9657-6b59e705f90e-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:12:57 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 Apr 29 19:12:57 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:57 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.info" returned: 0 in 0.646s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.405s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.764s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-150896554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f418ef7c-e3e2-4014-8a22-18578bad0612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df2f42bc97f4906b601ac0ed10f102f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:45Z,use_quota=True,user_id='491b57b57b29492ea74a32d9947bdce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Creating volume f418ef7c-e3e2-4014-8a22-18578bad0612 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:12:57 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:57 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 1073741824 Apr 29 19:12:57 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:57 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9bd34c12-8aa1-4dc5-8a43-ec465b5dbb2e tempest-SnapshotsActionsTest-689829371 None] Create snapshot completed successfully Apr 29 19:12:57 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59" returned: 0 in 0.797s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93263abc-abb0-4572-913f-0dd025702b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:12:58 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b51c8-bf34-4db5-ac9d-41ea9a77e321]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:12:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:58 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c Apr 29 19:12:58 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:58 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 1073741824" returned: 0 in 0.840s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:58 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 Apr 29 19:12:58 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:58 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c" returned: 0 in 0.750s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:58 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 Apr 29 19:12:58 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:59 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612" returned: 0 in 0.632s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.071s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2066043319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22706d4-4ebb-4ea4-8d51-d5e532b389c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8471bea9df924d759109ad3b51275356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:12:46Z,use_quota=True,user_id='0ede86bae7894664b443da48303b45df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Creating volume a22706d4-4ebb-4ea4-8d51-d5e532b389c2 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:12:59 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f2107c-fc34-4876-a4c9-4a8e719a497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f418ef7c-e3e2-4014-8a22-18578bad0612', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:59 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 1073741824 Apr 29 19:12:59 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536625ac-b542-4906-9cc5-793575ba4f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:12:59 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Volume volume-f418ef7c-e3e2-4014-8a22-18578bad0612 (f418ef7c-e3e2-4014-8a22-18578bad0612): created successfully Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536625ac-b542-4906-9cc5-793575ba4f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Flow 'volume_create_manager' (38639da1-3602-40e3-99d7-030cc660daac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:12:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a03937cf-f3b6-4730-9b06-a126ca40901b tempest-VolumesMetadataTest-701985809 None] Created volume successfully. Apr 29 19:12:59 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59" returned: 0 in 0.782s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:12:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:12:59 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59 Apr 29 19:12:59 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:00 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 1073741824" returned: 0 in 0.839s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:00 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c.78c966da-3d78-4918-a0de-aea3e454db59" returned: 0 in 0.626s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-78c966da-3d78-4918-a0de-aea3e454db59" released by "_delete_snapshot" :: held 3.092s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-93263abc-abb0-4572-913f-0dd025702b0c" released by "delete_snapshot" :: held 3.159s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:00 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 Apr 29 19:13:00 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Created reservations ['8587942a-783d-4d71-bc94-b9de8fec8217', 'a60a7d7a-0fab-4302-86c0-7025ede5e88d', '727f472f-444c-4b94-a0b0-714172b8ba6d', 'c92729db-bcb6-4231-aa0d-2256018ee45a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:00 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Delete snapshot completed successfully. Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4568f70e-ae17-4b0a-9eeb-207eba723b78 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-78c966da-3d78-4918-a0de-aea3e454db59-delete_snapshot" released by "delete_snapshot" :: held 3.342s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:00 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2" returned: 0 in 0.627s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.854s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Creating offline snapshot 6bb9986f-404f-485c-8273-4aefe2bb82b3 of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df66f6f-e49b-4ec5-a6c5-b4edb5ec6e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8017303f-97c7-4399-af81-64a23217c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa1ee7d-137b-4bf9-a33f-b27ebd9801b1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:00 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Volume volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 (a22706d4-4ebb-4ea4-8d51-d5e532b389c2): created successfully Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8017303f-97c7-4399-af81-64a23217c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Flow 'volume_create_manager' (e51aba05-f7eb-4c80-a721-0fbd774ea3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:00 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e19af4c3-2ae2-4944-aaa4-57df0d178acd tempest-ServerRescueNegativeTestJSON-242354072 None] Created volume successfully. Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Acquiring lock "cinder-f418ef7c-e3e2-4014-8a22-18578bad0612-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:01 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:01 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Lock "cinder-f418ef7c-e3e2-4014-8a22-18578bad0612-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Acquiring lock "cinder-quobyte-f418ef7c-e3e2-4014-8a22-18578bad0612" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Lock "cinder-quobyte-f418ef7c-e3e2-4014-8a22-18578bad0612" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c811e6e-c2d3-4b7a-8a29-f5b18522d0b8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:01 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 Apr 29 19:13:01 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-93263abc-abb0-4572-913f-0dd025702b0c-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-93263abc-abb0-4572-913f-0dd025702b0c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-93263abc-abb0-4572-913f-0dd025702b0c" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-93263abc-abb0-4572-913f-0dd025702b0c" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce14db06-6418-4387-aef0-f020877ec8c8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:01 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c Apr 29 19:13:01 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:01 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.942s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:01 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 1G Apr 29 19:13:01 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:02 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612" returned: 0 in 0.904s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:02 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612 Apr 29 19:13:02 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:02 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c" returned: 0 in 0.961s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:02 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c Apr 29 19:13:02 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:02 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f418ef7c-e3e2-4014-8a22-18578bad0612" returned: 0 in 0.692s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:02 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 1G" returned: 0 in 0.896s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Lock "cinder-quobyte-f418ef7c-e3e2-4014-8a22-18578bad0612" released by "delete_volume" :: held 1.663s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:02 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 Apr 29 19:13:02 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Created reservations ['a9764298-e1fc-4511-bdf2-583af1c223b6', '7fe85ed2-2bd0-4a54-a422-beba13b9841b', '5c31a04d-eab3-4607-b9f6-c1c78d38fa95', 'a38bc700-e1b6-46c7-97d8-4680729068ef'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:02 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:02 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:03 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-93263abc-abb0-4572-913f-0dd025702b0c" returned: 0 in 0.753s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-93263abc-abb0-4572-913f-0dd025702b0c" released by "delete_volume" :: held 1.832s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Created reservations ['27326de1-d4dd-4a44-b574-f3a86b022ae7', '45d6a5fa-92c2-4ae3-96fc-e6d39c06615f', 'd7769d50-f15d-4487-b9b1-f7ca51dec8f8', 'e79bd4f4-db4c-4ae8-9657-1f8826e042c6'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:03 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:03 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:03 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.056s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:04 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Deleted volume successfully. Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd96d4ba-0379-4427-8fde-73d837763a26 tempest-VolumesMetadataTest-701985809 None] Lock "cinder-f418ef7c-e3e2-4014-8a22-18578bad0612-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:04 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3" returned: 0 in 1.288s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:04 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 is being set with open permissions: ugo+rw Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:04 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 Apr 29 19:13:04 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:04 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.157s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:04 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Deleted volume successfully. Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f068bbb-bf15-4f39-9d98-9472b69387cd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-93263abc-abb0-4572-913f-0dd025702b0c-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (fe9baf1a-c5d0-47c8-a80e-157fec2837e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548bd7c4-cfa7-4955-84c4-1a1caae76ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548bd7c4-cfa7-4955-84c4-1a1caae76ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1026729987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459bcb45-4c10-402a-9439-663812786451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7e017d1e8144b2ac5fe27ac7160a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:05Z,use_quota=True,user_id='465b9b09a1f64173b199399eb8a0889a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f0725f-5047-4c87-adf9-eeceddde679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f0725f-5047-4c87-adf9-eeceddde679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a28ec4-556b-4cf3-a4a3-175b3a3554b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a28ec4-556b-4cf3-a4a3-175b3a3554b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459bcb45-4c10-402a-9439-663812786451', 'volume_name': 'volume-459bcb45-4c10-402a-9439-663812786451', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c795c74-bdae-484b-ac32-2059acba9227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c795c74-bdae-484b-ac32-2059acba9227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481a07f2-5625-4d75-ae92-e4c9e2075611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:04 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Volume 459bcb45-4c10-402a-9439-663812786451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459bcb45-4c10-402a-9439-663812786451', 'volume_size': 1} Apr 29 19:13:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:05 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3" returned: 0 in 1.090s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.349s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1026729987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459bcb45-4c10-402a-9439-663812786451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7e017d1e8144b2ac5fe27ac7160a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:05Z,use_quota=True,user_id='465b9b09a1f64173b199399eb8a0889a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Creating volume 459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:13:05 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:05 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 1073741824 Apr 29 19:13:05 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:05 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-af4a738e-0382-4388-986f-cfc2fd184c56 tempest-SnapshotsActionsTest-689829371 None] Create snapshot completed successfully Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-6bb9986f-404f-485c-8273-4aefe2bb82b3-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-6bb9986f-404f-485c-8273-4aefe2bb82b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-quobyte-6bb9986f-404f-485c-8273-4aefe2bb82b3" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-6bb9986f-404f-485c-8273-4aefe2bb82b3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Deleting offline snapshot 6bb9986f-404f-485c-8273-4aefe2bb82b3 of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] snapshot_file for this snap is: volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea71dde-19be-4a47-83b6-77ba676ff1ed]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:05 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 Apr 29 19:13:05 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:06 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 1073741824" returned: 0 in 1.343s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:06 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 Apr 29 19:13:06 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:06 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3" returned: 0 in 1.202s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:06 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[044c881a-c0ee-4432-b434-95ba2c1f6058]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:07 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:07 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:07 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451" returned: 0 in 0.816s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] <== create_volume: return (2316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481a07f2-5625-4d75-ae92-e4c9e2075611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459bcb45-4c10-402a-9439-663812786451', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3663bc-17d2-4bbc-8d4b-a4c032248dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:07 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Volume volume-459bcb45-4c10-402a-9439-663812786451 (459bcb45-4c10-402a-9439-663812786451): created successfully Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3663bc-17d2-4bbc-8d4b-a4c032248dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (fe9baf1a-c5d0-47c8-a80e-157fec2837e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-50a3d7af-ec39-4f05-8928-ea50c0be7da0 tempest-VolumesSnapshotTestJSON-938417878 None] Created volume successfully. Apr 29 19:13:07 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.925s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:07 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 Apr 29 19:13:07 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Creating offline snapshot 0b464668-19e0-48e8-b115-e80ba99d0504 of volume 459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0a36d4-704c-4297-a29a-95cf8c4985fb]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:08 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 Apr 29 19:13:08 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:08 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3" returned: 0 in 0.896s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:08 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3 Apr 29 19:13:08 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:08 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451" returned: 0 in 0.827s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:09 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 1G Apr 29 19:13:09 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Flow 'volume_create_manager' (554017eb-107f-4ff5-995a-1dad26aa06d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d01bf23-d487-4c2e-a1bb-0b0578024b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d01bf23-d487-4c2e-a1bb-0b0578024b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-3673257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266a24dc-153b-46ca-b68a-2fc4083fa73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a362b30343bd8be19209dc9ccdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:09Z,use_quota=True,user_id='2ee0a4c44b8b4277be1363a38237f8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0beb969-4322-4d6d-a24e-57ad29a79a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0beb969-4322-4d6d-a24e-57ad29a79a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675bb031-e098-40a7-bccc-6a52574c7661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675bb031-e098-40a7-bccc-6a52574c7661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266a24dc-153b-46ca-b68a-2fc4083fa73b', 'volume_name': 'volume-266a24dc-153b-46ca-b68a-2fc4083fa73b', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6199284-f079-4c1f-86e5-606681f38d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6199284-f079-4c1f-86e5-606681f38d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f18b73-3690-4d55-966f-0138120b5b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:09 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Volume 266a24dc-153b-46ca-b68a-2fc4083fa73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266a24dc-153b-46ca-b68a-2fc4083fa73b', 'volume_size': 1} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:09 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.6bb9986f-404f-485c-8273-4aefe2bb82b3" returned: 0 in 0.724s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-6bb9986f-404f-485c-8273-4aefe2bb82b3" released by "_delete_snapshot" :: held 3.884s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" released by "delete_snapshot" :: held 3.915s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Created reservations ['21bc51ed-699d-442a-9755-d13da90fda8e', '448779bf-ed54-4ea5-ba45-82f970b25aef', '995426db-f761-4006-bc59-9c6cdec8c29e', '79b781a5-9631-4854-b80b-f8ba74202c0d'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:09 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Delete snapshot completed successfully. Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e6fa7-3e9f-4a0d-9447-bfa4e781c7e1 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-6bb9986f-404f-485c-8273-4aefe2bb82b3-delete_snapshot" released by "delete_snapshot" :: held 4.052s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:09 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 1G" returned: 0 in 0.808s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459bcb45-4c10-402a-9439-663812786451 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:09 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459bcb45-4c10-402a-9439-663812786451 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 Apr 29 19:13:09 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:10 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459bcb45-4c10-402a-9439-663812786451 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504" returned: 0 in 0.687s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:10 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 is being set with open permissions: ugo+rw Apr 29 19:13:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:10 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 Apr 29 19:13:10 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:11 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504" returned: 0 in 0.565s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:11 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=109,cinder:INSERT=26,cinder:UPDATE=99,cinder:DELETE=9 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:13:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:11 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.info Apr 29 19:13:11 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:11 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.info" returned: 0 in 0.581s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:11 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.info is being set with open permissions: ugo+rw Apr 29 19:13:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:11 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.info Apr 29 19:13:11 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:12 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.info" returned: 0 in 0.813s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.388s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.045s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-3673257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266a24dc-153b-46ca-b68a-2fc4083fa73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a362b30343bd8be19209dc9ccdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:09Z,use_quota=True,user_id='2ee0a4c44b8b4277be1363a38237f8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Creating volume 266a24dc-153b-46ca-b68a-2fc4083fa73b {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:13:12 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:13:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:12 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b 1073741824 Apr 29 19:13:12 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:12 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7d5f6ac5-1ed3-4484-8361-4b713b638ff1 tempest-VolumesSnapshotTestJSON-938417878 None] Create snapshot completed successfully Apr 29 19:13:13 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b 1073741824" returned: 0 in 0.931s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:13 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b Apr 29 19:13:13 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:13 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (2f6b36fe-32a2-4e25-9465-171c7a5773fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86939c1d-5e6e-4c44-8c0e-9d27204fd9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86939c1d-5e6e-4c44-8c0e-9d27204fd9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1606471485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7e017d1e8144b2ac5fe27ac7160a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b464668-19e0-48e8-b115-e80ba99d0504,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:14Z,use_quota=True,user_id='465b9b09a1f64173b199399eb8a0889a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502c050f-99ec-4540-ae87-90930172aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502c050f-99ec-4540-ae87-90930172aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3ef224-a079-430e-aa22-8fcd1732ce29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3ef224-a079-430e-aa22-8fcd1732ce29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7', 'volume_name': 'volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7', 'volume_size': 1, 'snapshot_id': '0b464668-19e0-48e8-b115-e80ba99d0504'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b45a01a-2582-40df-9454-0c087395458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b45a01a-2582-40df-9454-0c087395458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e24ab1-8e36-4432-b778-ee050c200f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:14 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Volume dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7', 'volume_size': 1, 'snapshot_id': '0b464668-19e0-48e8-b115-e80ba99d0504'} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:14 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b" returned: 0 in 0.760s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.123s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f18b73-3690-4d55-966f-0138120b5b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266a24dc-153b-46ca-b68a-2fc4083fa73b', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9c3cfd-50f5-4704-98a7-6e3dad21350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Creating offline snapshot 275e603a-a4f2-41c1-986b-a44cbc1696bf of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:13:14 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Volume volume-266a24dc-153b-46ca-b68a-2fc4083fa73b (266a24dc-153b-46ca-b68a-2fc4083fa73b): created successfully Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9c3cfd-50f5-4704-98a7-6e3dad21350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Flow 'volume_create_manager' (554017eb-107f-4ff5-995a-1dad26aa06d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c94eb1-07ee-4e61-a23f-028d25b0aa4a]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:14 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-bc37eca2-bc09-4069-bfc7-3ad943cbc96a tempest-VolumesTransfersTest-883202539 None] Created volume successfully. Apr 29 19:13:14 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:14 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:15 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.916s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:15 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf 1G Apr 29 19:13:15 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:15 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-68608a09-1865-430d-9c40-579420dde797 tempest-VolumesTransfersTest-1113181129 None] Transfer volume completed successfully. Apr 29 19:13:16 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf 1G" returned: 0 in 0.969s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:16 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf Apr 29 19:13:16 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Acquiring lock "cinder-266a24dc-153b-46ca-b68a-2fc4083fa73b-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Lock "cinder-266a24dc-153b-46ca-b68a-2fc4083fa73b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Acquiring lock "cinder-quobyte-266a24dc-153b-46ca-b68a-2fc4083fa73b" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Lock "cinder-quobyte-266a24dc-153b-46ca-b68a-2fc4083fa73b" acquired by "delete_volume" :: waited 0.042s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:16 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2248a6-1bfc-46de-b219-773b545e60f6]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:16 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b Apr 29 19:13:16 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:17 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf" returned: 0 in 0.762s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:17 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf is being set with open permissions: ugo+rw Apr 29 19:13:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:17 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf Apr 29 19:13:17 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:17 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b" returned: 0 in 0.899s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:17 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b Apr 29 19:13:17 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:18 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf" returned: 0 in 0.955s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.801s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-0b464668-19e0-48e8-b115-e80ba99d0504-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" by "_create_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-0b464668-19e0-48e8-b115-e80ba99d0504-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Creating volume dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 from snapshot 0b464668-19e0-48e8-b115-e80ba99d0504 {{(pid=84523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5b1025e5-7b95-4bfc-84c9-447d94380316 tempest-SnapshotsActionsTest-689829371 None] Create snapshot completed successfully Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] snapshot: 0b464668-19e0-48e8-b115-e80ba99d0504, volume: dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc2659-0df1-4e7a-b56f-1d339c23febf]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:18 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 Apr 29 19:13:18 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:18 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-266a24dc-153b-46ca-b68a-2fc4083fa73b" returned: 0 in 1.023s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Lock "cinder-quobyte-266a24dc-153b-46ca-b68a-2fc4083fa73b" released by "delete_volume" :: held 1.977s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-275e603a-a4f2-41c1-986b-a44cbc1696bf-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Created reservations ['6c5c0f47-c325-4376-8630-2ad7ca1720b3', 'b4ec8a9a-690c-4e91-8cde-05326f9efd1a', '97be2244-1360-4768-8940-e367c7a30292', '785fdb7f-0d3d-45f5-9264-868540ddffc7'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-275e603a-a4f2-41c1-986b-a44cbc1696bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-quobyte-275e603a-a4f2-41c1-986b-a44cbc1696bf" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-275e603a-a4f2-41c1-986b-a44cbc1696bf" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Deleting offline snapshot 275e603a-a4f2-41c1-986b-a44cbc1696bf of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] snapshot_file for this snap is: volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c9bad2-6e34-4ccb-a192-429f82cbcec3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:19 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:19 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:19 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf Apr 29 19:13:19 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:19 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504" returned: 0 in 1.218s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459bcb45-4c10-402a-9439-663812786451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5fc0f1-0f24-4d66-9e1b-76e43461f3da]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:19 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 Apr 29 19:13:19 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:20 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf" returned: 0 in 1.166s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[65292b38-dd7b-4bf8-b838-84bb0358ccdc]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:20 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.156s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:20 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Deleted volume successfully. Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eb5fbb90-7563-4ed4-b6f9-d9143941d43b tempest-VolumesTransfersTest-662717030 None] Lock "cinder-266a24dc-153b-46ca-b68a-2fc4083fa73b-delete_volume" released by "delete_volume" :: held 3.651s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:20 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:20 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:20 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451" returned: 0 in 1.132s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:20 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 Apr 29 19:13:20 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Acquiring lock "cinder-a22706d4-4ebb-4ea4-8d51-d5e532b389c2-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "cinder-a22706d4-4ebb-4ea4-8d51-d5e532b389c2-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Acquiring lock "cinder-quobyte-a22706d4-4ebb-4ea4-8d51-d5e532b389c2" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "cinder-quobyte-a22706d4-4ebb-4ea4-8d51-d5e532b389c2" acquired by "delete_volume" :: waited 0.038s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53e5e6b-1833-4ba5-80d1-44114ba6f967]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Flow 'volume_create_manager' (59608471-fe26-4e7f-9da0-36c045a77ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc7b696-1b3e-4d9a-a92d-061701e19357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:21 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 Apr 29 19:13:21 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc7b696-1b3e-4d9a-a92d-061701e19357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1395483387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1001af19-147c-4b62-97bd-ba12fc9aa2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a362b30343bd8be19209dc9ccdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:21Z,use_quota=True,user_id='2ee0a4c44b8b4277be1363a38237f8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0051ab-8ad5-4ff0-9dce-87bee2a1e876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0051ab-8ad5-4ff0-9dce-87bee2a1e876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e10602-2490-47e0-99de-9023e6fa3893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e10602-2490-47e0-99de-9023e6fa3893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1001af19-147c-4b62-97bd-ba12fc9aa2f8', 'volume_name': 'volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbd945d-b72e-43e7-83bd-4982012dbe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbd945d-b72e-43e7-83bd-4982012dbe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a816b0c-7110-4f9a-9c0f-c7270d2d96ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:21 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Volume 1001af19-147c-4b62-97bd-ba12fc9aa2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8', 'volume_size': 1} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:21 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 1.505s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:21 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf Apr 29 19:13:21 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:23 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2" returned: 0 in 2.377s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:23 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2 Apr 29 19:13:23 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:24 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf" returned: 0 in 2.401s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:24 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf Apr 29 19:13:24 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:25 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a22706d4-4ebb-4ea4-8d51-d5e532b389c2" returned: 0 in 2.007s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "cinder-quobyte-a22706d4-4ebb-4ea4-8d51-d5e532b389c2" released by "delete_volume" :: held 4.514s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:25 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Created reservations ['b53dd903-46dc-43ad-a916-9e310fe66b85', 'ec421f5b-4a0d-42f2-9109-f6ee599e5883', '4e5584d9-6349-490a-b224-86b2f74c4ab9', 'd63a4079-2c32-48e1-bad0-5ec7ef73a262'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:26 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:26 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:27 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.275e603a-a4f2-41c1-986b-a44cbc1696bf" returned: 0 in 3.088s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:27 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-275e603a-a4f2-41c1-986b-a44cbc1696bf" released by "_delete_snapshot" :: held 8.444s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:27 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" released by "delete_snapshot" :: held 8.517s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:27 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Created reservations ['3c2d7ecd-0251-49ee-a710-452a15a9a6a4', '339a0242-efba-4c07-a564-cd300b78b90a', '7ff9d9ea-fdbb-461a-9606-dc34eeeeb43a', '41b1b98c-66cd-4f1a-b0bf-30af9cee4e1d'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:27 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Delete snapshot completed successfully. Apr 29 19:13:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-68cf496f-48f4-40c0-b0c9-467edefb2e6c tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-275e603a-a4f2-41c1-986b-a44cbc1696bf-delete_snapshot" released by "delete_snapshot" :: held 9.191s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:28 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 2.473s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:28 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:28 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Deleted volume successfully. Apr 29 19:13:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-29446389-23ee-4e4c-a875-558847b06c5e tempest-ServerRescueNegativeTestJSON-242354072 None] Lock "cinder-a22706d4-4ebb-4ea4-8d51-d5e532b389c2-delete_volume" released by "delete_volume" :: held 7.676s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:13:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:29 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:29 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:30 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" returned: 0 in 9.591s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[87212e68-05fe-451f-a577-cf81ecf5b72c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:30 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 Apr 29 19:13:30 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:30 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.914s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:13:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:13:31 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451" returned: 0 in 1.035s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:31 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451, size 1024.00 MB, duration 9.59 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:13:31 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Converted 1024.00 MB image at 106.74 MB/s Apr 29 19:13:31 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 is being set with open permissions: ugo+rw Apr 29 19:13:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:31 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 Apr 29 19:13:31 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:31 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" returned: 0 in 0.612s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" released by "_copy_volume_from_snapshot" :: held 13.780s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-0b464668-19e0-48e8-b115-e80ba99d0504-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" released by "_create_volume_from_snapshot" :: held 13.855s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.912s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.480s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1395483387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1001af19-147c-4b62-97bd-ba12fc9aa2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a362b30343bd8be19209dc9ccdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:21Z,use_quota=True,user_id='2ee0a4c44b8b4277be1363a38237f8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Creating volume 1001af19-147c-4b62-97bd-ba12fc9aa2f8 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:13:32 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:32 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 1073741824 Apr 29 19:13:32 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e24ab1-8e36-4432-b778-ee050c200f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7', 'volume_size': 1, 'snapshot_id': '0b464668-19e0-48e8-b115-e80ba99d0504'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bde694-0ef5-4f46-a085-616cb505def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:32 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Volume volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 (dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7): created successfully Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bde694-0ef5-4f46-a085-616cb505def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Flow 'volume_create_manager' (2f6b36fe-32a2-4e25-9465-171c7a5773fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:32 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2d78f72e-a4cd-42ad-8a46-88ac9990c1c9 tempest-VolumesSnapshotTestJSON-938417878 None] Created volume successfully. Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" acquired by "delete_volume" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb872ce-2951-4990-9b33-94bb463c3e76]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:32 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 Apr 29 19:13:32 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:32 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 1073741824" returned: 0 in 0.841s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:32 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 Apr 29 19:13:32 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:33 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" returned: 0 in 0.794s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:33 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7 Apr 29 19:13:33 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:33 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8" returned: 0 in 0.648s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.324s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Creating offline snapshot 8afe6351-8a50-4c75-9fad-8aebdb4a3b5d of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a816b0c-7110-4f9a-9c0f-c7270d2d96ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2de0e1-5e9f-4a3b-ae00-a7a36b2d27f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7176678c-428e-4618-a53e-a0138e45be90]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:33 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Volume volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 (1001af19-147c-4b62-97bd-ba12fc9aa2f8): created successfully Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2de0e1-5e9f-4a3b-ae00-a7a36b2d27f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Flow 'volume_create_manager' (59608471-fe26-4e7f-9da0-36c045a77ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-02eb380c-a4e0-4cd0-b131-fc0f04f7805e tempest-VolumesTransfersTest-883202539 None] Created volume successfully. Apr 29 19:13:33 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:33 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:33 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" returned: 0 in 0.631s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7" released by "delete_volume" :: held 1.481s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Created reservations ['a5795113-2937-4ca9-81e3-955f1b1c1ea7', '291f522a-d510-4f81-9cf6-024521e773cc', 'e1f2dbda-b4da-4534-af23-6e1a3634aab0', '802661eb-abf8-4748-97f3-15d39b397213'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:34 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:34 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:34 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.779s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:34 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d 1G Apr 29 19:13:34 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:34 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.653s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:34 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Deleted volume successfully. Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-0b464668-19e0-48e8-b115-e80ba99d0504-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-0b464668-19e0-48e8-b115-e80ba99d0504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-459bcb45-4c10-402a-9439-663812786451" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9f2a567a-2d4a-4c76-9985-5aac77e3cedd tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-dcd3dba7-c64c-4ce2-8dde-5facbf3c54d7-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-459bcb45-4c10-402a-9439-663812786451" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-0b464668-19e0-48e8-b115-e80ba99d0504" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-0b464668-19e0-48e8-b115-e80ba99d0504" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Deleting offline snapshot 0b464668-19e0-48e8-b115-e80ba99d0504 of volume 459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] snapshot_file for this snap is: volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[837004ad-40ca-4cd2-8bb6-c68706bad705]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:35 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 Apr 29 19:13:35 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Acquiring lock "cinder-1001af19-147c-4b62-97bd-ba12fc9aa2f8-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Lock "cinder-1001af19-147c-4b62-97bd-ba12fc9aa2f8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Acquiring lock "cinder-quobyte-1001af19-147c-4b62-97bd-ba12fc9aa2f8" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Lock "cinder-quobyte-1001af19-147c-4b62-97bd-ba12fc9aa2f8" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf9cd9b-c1a1-400a-98f3-b2ae4edfb88b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:35 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 Apr 29 19:13:35 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:35 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d 1G" returned: 0 in 0.968s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:35 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d Apr 29 19:13:35 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:35 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504" returned: 0 in 0.976s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459bcb45-4c10-402a-9439-663812786451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf65e94-2ca2-4b9a-9c6e-5978bcbc45e2]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:36 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 Apr 29 19:13:36 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:36 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8" returned: 0 in 0.972s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:36 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8 Apr 29 19:13:36 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:36 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d" returned: 0 in 0.944s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:36 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d is being set with open permissions: ugo+rw Apr 29 19:13:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:36 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d Apr 29 19:13:36 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:36 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451" returned: 0 in 0.887s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:36 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 Apr 29 19:13:36 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:36 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1001af19-147c-4b62-97bd-ba12fc9aa2f8" returned: 0 in 0.716s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Lock "cinder-quobyte-1001af19-147c-4b62-97bd-ba12fc9aa2f8" released by "delete_volume" :: held 1.740s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=87,cinder:INSERT=30,cinder:UPDATE=114,cinder:DELETE=10 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:13:37 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d" returned: 0 in 0.738s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.575s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:37 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6acef7c7-9544-4087-a45f-14a15901cbe9 tempest-SnapshotsActionsTest-689829371 None] Create snapshot completed successfully Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Created reservations ['cf52ccff-f5b7-4f67-8a47-e987fea340d2', '2167c1a4-1532-4f0e-af43-576ffba14b46', 'b93467bc-d41d-4e60-ac06-3841cd919ab6', 'a7db4956-b562-41bf-9ebe-a13ea6251861'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:37 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:37 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-8afe6351-8a50-4c75-9fad-8aebdb4a3b5d-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-8afe6351-8a50-4c75-9fad-8aebdb4a3b5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:37 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504" returned: 0 in 0.931s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-quobyte-8afe6351-8a50-4c75-9fad-8aebdb4a3b5d" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:37 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504 Apr 29 19:13:37 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-8afe6351-8a50-4c75-9fad-8aebdb4a3b5d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Deleting offline snapshot 8afe6351-8a50-4c75-9fad-8aebdb4a3b5d of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] snapshot_file for this snap is: volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f38aac2-3b5a-4dba-8925-bf3d5f6b430b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:38 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d Apr 29 19:13:38 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:38 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.949s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Deleted volume successfully. Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dd6032ff-6115-4305-8cf0-b0a3e0a1f064 tempest-VolumesTransfersTest-662717030 None] Lock "cinder-1001af19-147c-4b62-97bd-ba12fc9aa2f8-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:38 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451.0b464668-19e0-48e8-b115-e80ba99d0504" returned: 0 in 0.726s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-0b464668-19e0-48e8-b115-e80ba99d0504" released by "_delete_snapshot" :: held 3.671s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-459bcb45-4c10-402a-9439-663812786451" released by "delete_snapshot" :: held 3.697s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Created reservations ['52dc6e92-9c43-4c34-bd05-2257a00734a9', '20b98596-2d35-49cc-a522-6523b77b033b', '6568fa22-1bc1-4aea-962b-c51a58b226cb', '6c87c919-1972-4d16-9a2e-04c5fdca0815'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Delete snapshot completed successfully. Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bc870a67-3d53-402e-99f2-05186518b098 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-0b464668-19e0-48e8-b115-e80ba99d0504-delete_snapshot" released by "delete_snapshot" :: held 3.963s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:38 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d" returned: 0 in 0.998s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac12efe-0cc8-4993-9a8d-2559f0ad82db]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:39 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:39 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-459bcb45-4c10-402a-9439-663812786451-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-459bcb45-4c10-402a-9439-663812786451-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-459bcb45-4c10-402a-9439-663812786451" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-459bcb45-4c10-402a-9439-663812786451" acquired by "delete_volume" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[731d5e71-964f-4a75-b901-2ab735b3b261]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:39 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 Apr 29 19:13:39 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:39 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.828s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:39 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d Apr 29 19:13:39 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:40 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451" returned: 0 in 0.864s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:40 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451 Apr 29 19:13:40 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:40 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d" returned: 0 in 0.862s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:40 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d Apr 29 19:13:40 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:40 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-459bcb45-4c10-402a-9439-663812786451" returned: 0 in 0.750s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-459bcb45-4c10-402a-9439-663812786451" released by "delete_volume" :: held 1.706s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Created reservations ['f4a04de1-d931-40c0-928e-02188259949c', 'b2f4b3f4-5808-4660-9b06-6f3a8ccba3a4', '7be526b9-d99e-48d5-a053-bacba05b9f4a', '9c64119a-00df-449f-9c35-618f53bc6b49'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:41 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:41 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:41 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.8afe6351-8a50-4c75-9fad-8aebdb4a3b5d" returned: 0 in 0.723s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-8afe6351-8a50-4c75-9fad-8aebdb4a3b5d" released by "_delete_snapshot" :: held 3.523s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" released by "delete_snapshot" :: held 3.556s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Created reservations ['bd3ac807-d313-439e-aa0b-550e8995c24d', 'a7d09019-ae61-419e-864c-4b2ac511805d', '1fde5d2a-3955-4e56-8827-189042f50c71', 'ee706233-8bbc-4edf-9aef-bc6923764df1'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:41 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Delete snapshot completed successfully. Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-89bcec82-c736-4f78-934a-c0472479c963 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-8afe6351-8a50-4c75-9fad-8aebdb4a3b5d-delete_snapshot" released by "delete_snapshot" :: held 3.753s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "cinder-quobyte-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f948a3f5-a7e9-40f4-81c9-5afdb93a2aa3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:41 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.675s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:41 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Deleted volume successfully. Apr 29 19:13:41 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 Apr 29 19:13:41 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a95393bc-cd3a-4298-9cea-673cb403428e tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-459bcb45-4c10-402a-9439-663812786451-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Creating offline snapshot e00199e1-b92f-48e6-a8b7-c01a4e813db8 of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:13:42 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10134ab-c402-48a9-b17d-067e6bf4d03f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:42 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" returned: 0 in 0.898s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:42 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:42 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:42 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9 Apr 29 19:13:42 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:43 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.873s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:43 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 1G Apr 29 19:13:43 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:43 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" returned: 0 in 0.803s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-quobyte-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9" released by "delete_volume" :: held 1.792s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Created reservations ['baefdaed-9787-447e-b8e3-5d69c56de110', '3d3c60e4-3b7b-43ac-8cce-d7ead7795591', 'f30b9a69-90cf-47c1-9b0a-1b613b157046', '0adcfdb9-f948-4d63-8ba6-1c3b855092a0'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:43 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:43 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:44 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.814s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:44 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:44 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Deleted volume successfully. Apr 29 19:13:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-447fd81d-023b-4de0-a45d-e81f284c08c0 tempest-VolumesSnapshotTestJSON-938417878 None] Lock "cinder-5d8fd47a-ee63-4a9e-bc33-43e11bc3c2d9-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:44 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 1G" returned: 0 in 1.148s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:44 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 Apr 29 19:13:44 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:45 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8" returned: 0 in 1.004s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:45 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 is being set with open permissions: ugo+rw Apr 29 19:13:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:45 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 Apr 29 19:13:45 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Flow 'volume_create_manager' (a88d972e-776a-4d16-8444-d4d87d19aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa1139a-cc9e-402c-8dd2-a149fda7d7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa1139a-cc9e-402c-8dd2-a149fda7d7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1033883622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e9aec6-d003-4d9a-888d-1f8ba77b8521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8a255e5efc4991bfbd9e5d95d40f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:46Z,use_quota=True,user_id='c530f4e8b371416e8e357726d222f565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac30f92-8bae-4dc2-b6fd-3ea5a8a1bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac30f92-8bae-4dc2-b6fd-3ea5a8a1bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2f83f3-5cf2-4ec3-90c2-f953c8aacd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2f83f3-5cf2-4ec3-90c2-f953c8aacd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e9aec6-d003-4d9a-888d-1f8ba77b8521', 'volume_name': 'volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0408f7-5cfc-41c5-af23-e1dd6ddcb3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0408f7-5cfc-41c5-af23-e1dd6ddcb3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d71ed84-d2ea-45ed-b40b-5d2c27d49b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:46 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Volume 02e9aec6-d003-4d9a-888d-1f8ba77b8521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521', 'volume_size': 1} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:46 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8" returned: 0 in 0.846s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.012s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.195s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1033883622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e9aec6-d003-4d9a-888d-1f8ba77b8521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8a255e5efc4991bfbd9e5d95d40f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:46Z,use_quota=True,user_id='c530f4e8b371416e8e357726d222f565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Creating volume 02e9aec6-d003-4d9a-888d-1f8ba77b8521 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:13:46 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:46 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 1073741824 Apr 29 19:13:46 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:46 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5e5ffbc5-7549-481a-8e36-dfbd20feb18c tempest-SnapshotsActionsTest-689829371 None] Create snapshot completed successfully Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-e00199e1-b92f-48e6-a8b7-c01a4e813db8-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-e00199e1-b92f-48e6-a8b7-c01a4e813db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Acquiring lock "cinder-quobyte-e00199e1-b92f-48e6-a8b7-c01a4e813db8" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-e00199e1-b92f-48e6-a8b7-c01a4e813db8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Deleting offline snapshot e00199e1-b92f-48e6-a8b7-c01a4e813db8 of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:13:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] snapshot_file for this snap is: volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:13:47 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9850c5-0a3b-4d9e-bf4d-fe336fa9585e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:47 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 Apr 29 19:13:47 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:47 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 1073741824" returned: 0 in 1.229s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:47 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 Apr 29 19:13:47 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:48 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8" returned: 0 in 0.977s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac60c63-2f65-4571-92ff-01990224acdb]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:48 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:48 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:48 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521" returned: 0 in 0.741s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d71ed84-d2ea-45ed-b40b-5d2c27d49b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12f5c20-485d-46cf-a6be-fab879946881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:48 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Volume volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 (02e9aec6-d003-4d9a-888d-1f8ba77b8521): created successfully Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12f5c20-485d-46cf-a6be-fab879946881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Flow 'volume_create_manager' (a88d972e-776a-4d16-8444-d4d87d19aebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:48 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-167856fe-917d-4750-90ad-b639c959f291 tempest-VolumesTransfersV357Test-1466465143 None] Created volume successfully. Apr 29 19:13:49 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.926s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:49 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 Apr 29 19:13:49 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:49 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8" returned: 0 in 0.867s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:49 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8 Apr 29 19:13:49 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:50 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2cbf734e-124b-41ac-a166-ba2e20b13aee tempest-VolumesTransfersV357Test-656444545 None] Transfer volume completed successfully. Apr 29 19:13:50 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.e00199e1-b92f-48e6-a8b7-c01a4e813db8" returned: 0 in 0.713s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-e00199e1-b92f-48e6-a8b7-c01a4e813db8" released by "_delete_snapshot" :: held 3.656s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" released by "delete_snapshot" :: held 3.694s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:50 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Created reservations ['5251e702-29da-4035-a3ad-9f80e874642b', '028b30ce-732c-4ddd-b1fd-4b12c55744d0', 'ae0f698e-1c11-4da4-8aab-c1ed1524ab7d', '1d40b580-ab67-4030-ab14-9ba3f566f488'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:50 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Delete snapshot completed successfully. Apr 29 19:13:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-775b9b08-2c1d-46dd-b825-7427754928f6 tempest-SnapshotsActionsTest-1294243633 None] Lock "cinder-e00199e1-b92f-48e6-a8b7-c01a4e813db8-delete_snapshot" released by "delete_snapshot" :: held 3.876s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Flow 'volume_create_manager' (fe6cbb3b-8764-4341-9f41-5cbcdd294e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bae806c-148c-409a-925a-f46845a15b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bae806c-148c-409a-925a-f46845a15b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1218703412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9bb5ca-8a32-4c2d-a357-7d90a76098ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72594bd777624030b4aac5c456b81cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:51Z,use_quota=True,user_id='cdcbc02dda5148a3936fe30029143c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42678f25-ddc1-498f-8df4-bde480fb5e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42678f25-ddc1-498f-8df4-bde480fb5e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb7ce53-4070-4cb1-8fae-ef1dc23da0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb7ce53-4070-4cb1-8fae-ef1dc23da0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e9bb5ca-8a32-4c2d-a357-7d90a76098ed', 'volume_name': 'volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df2b70e-5b56-4c1f-af86-e1939b6be959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df2b70e-5b56-4c1f-af86-e1939b6be959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aaa8df-4548-4a9a-a0c5-1842e309384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Volume 1e9bb5ca-8a32-4c2d-a357-7d90a76098ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed', 'volume_size': 1} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1218703412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9bb5ca-8a32-4c2d-a357-7d90a76098ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72594bd777624030b4aac5c456b81cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:51Z,use_quota=True,user_id='cdcbc02dda5148a3936fe30029143c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Creating volume 1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:13:51 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:51 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed 1073741824 Apr 29 19:13:51 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Flow 'volume_create_manager' (d9dae770-63b0-4473-a366-3765c1c0a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd4638f-edeb-4d70-99ea-c5c9fb30cf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd4638f-edeb-4d70-99ea-c5c9fb30cf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-232768845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55518f85-ad33-43b3-b76d-bb970d3cce83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='167b895a788a49b885940d16b833a3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:51Z,use_quota=True,user_id='20ff182aae094e89ba0feefa9da23a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43389fb-18b9-48ef-822b-121b4d5642a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43389fb-18b9-48ef-822b-121b4d5642a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8a2472-b510-47f4-a69a-b2aedcb411a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8a2472-b510-47f4-a69a-b2aedcb411a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55518f85-ad33-43b3-b76d-bb970d3cce83', 'volume_name': 'volume-55518f85-ad33-43b3-b76d-bb970d3cce83', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b04a85-5907-45fa-867d-c0768a7794e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b04a85-5907-45fa-867d-c0768a7794e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df6d225-5a9a-416a-b8f5-ee72f27f542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Volume 55518f85-ad33-43b3-b76d-bb970d3cce83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55518f85-ad33-43b3-b76d-bb970d3cce83', 'volume_size': 1} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Acquiring lock "cinder-02e9aec6-d003-4d9a-888d-1f8ba77b8521-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Lock "cinder-02e9aec6-d003-4d9a-888d-1f8ba77b8521-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Acquiring lock "cinder-quobyte-02e9aec6-d003-4d9a-888d-1f8ba77b8521" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Lock "cinder-quobyte-02e9aec6-d003-4d9a-888d-1f8ba77b8521" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[853c443a-cefb-408a-a556-cce20c9ddb93]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "cinder-d9c7c875-f191-4e3d-bd89-fd2b9a1740c5-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-d9c7c875-f191-4e3d-bd89-fd2b9a1740c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "cinder-quobyte-d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:51 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 Apr 29 19:13:51 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-quobyte-d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Deleting offline snapshot d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 of volume ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] snapshot_file for this snap is: volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d997fd7a-ea3f-4ea3-acd7-35e0a83b1724]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:52 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:52 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:52 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed 1073741824" returned: 0 in 1.015s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:52 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:52 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521" returned: 0 in 0.787s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:52 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:52 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521 Apr 29 19:13:52 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:52 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.808s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b90cbf-ab45-4e79-9210-4cc42bbbf62f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:52 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 Apr 29 19:13:52 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:53 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" returned: 0 in 0.629s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-232768845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55518f85-ad33-43b3-b76d-bb970d3cce83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='167b895a788a49b885940d16b833a3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:51Z,use_quota=True,user_id='20ff182aae094e89ba0feefa9da23a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Creating volume 55518f85-ad33-43b3-b76d-bb970d3cce83 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:13:53 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aaa8df-4548-4a9a-a0c5-1842e309384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:53 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 1073741824 Apr 29 19:13:53 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:53 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050dcbbe-b206-4336-a2da-ecdbd29ffb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02e9aec6-d003-4d9a-888d-1f8ba77b8521" returned: 0 in 0.653s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:53 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Volume volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed (1e9bb5ca-8a32-4c2d-a357-7d90a76098ed): created successfully Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050dcbbe-b206-4336-a2da-ecdbd29ffb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Flow 'volume_create_manager' (fe6cbb3b-8764-4341-9f41-5cbcdd294e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Lock "cinder-quobyte-02e9aec6-d003-4d9a-888d-1f8ba77b8521" released by "delete_volume" :: held 1.507s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0abf09a8-f318-4245-bffd-874a8beb2339 tempest-VolumesSnapshotListTestJSON-397637868 None] Created volume successfully. Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Created reservations ['f5823bd2-ece9-4a0b-9486-a177c11e80dd', 'b255199c-e3d9-4424-8e8e-7300f456a759', '03fac931-3a2d-4d3e-b852-550e29523e18', '30ee4e4c-9702-446e-b5be-b95007aa1a21'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:53 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:53 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:53 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" returned: 0 in 0.835s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:53 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:53 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:54 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 1073741824" returned: 0 in 0.869s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:54 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.743s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Deleted volume successfully. Apr 29 19:13:54 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 Apr 29 19:13:54 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-779fdda1-00d9-428a-9921-3544de7bd01b tempest-VolumesTransfersV357Test-742392961 None] Lock "cinder-02e9aec6-d003-4d9a-888d-1f8ba77b8521-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Flow 'volume_create_manager' (fc509f14-cb75-4b46-876a-efb78f42b1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a536f3-1454-4488-aebe-edddbec4d895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a536f3-1454-4488-aebe-edddbec4d895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-860060459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a086859c-14a5-4d56-9b89-d700929ede21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8a255e5efc4991bfbd9e5d95d40f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:54Z,use_quota=True,user_id='c530f4e8b371416e8e357726d222f565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f54f230-317b-4c75-8d17-1dad2e6308a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f54f230-317b-4c75-8d17-1dad2e6308a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74480a16-7077-4e18-8d6e-6e2a45f3b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74480a16-7077-4e18-8d6e-6e2a45f3b16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a086859c-14a5-4d56-9b89-d700929ede21', 'volume_name': 'volume-a086859c-14a5-4d56-9b89-d700929ede21', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:54 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b096c76a-973e-4cd6-8d88-745d517d94bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b096c76a-973e-4cd6-8d88-745d517d94bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6931da12-5faf-47c5-a948-89dca5eb871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:54 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Volume a086859c-14a5-4d56-9b89-d700929ede21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a086859c-14a5-4d56-9b89-d700929ede21', 'volume_size': 1} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.885s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:54 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5 Apr 29 19:13:54 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:54 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83" returned: 0 in 0.725s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.100s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df6d225-5a9a-416a-b8f5-ee72f27f542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55518f85-ad33-43b3-b76d-bb970d3cce83', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a76cc7-a53e-4c71-be54-966e316211f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Creating offline snapshot 8e1e05fc-4267-41c2-857f-8f9f556df6fa of volume 1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:13:54 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Volume volume-55518f85-ad33-43b3-b76d-bb970d3cce83 (55518f85-ad33-43b3-b76d-bb970d3cce83): created successfully Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a76cc7-a53e-4c71-be54-966e316211f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Flow 'volume_create_manager' (d9dae770-63b0-4473-a366-3765c1c0a79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c38c1b0-af9a-4423-90a5-9197f3623c1b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-04b20160-f915-42c5-bfa5-088fa5ac9f42 req-4dd0ff28-8e8e-4fc7-aada-864cf2baa27b tempest-VolumesGetTestJSON-443470388 None] Created volume successfully. Apr 29 19:13:55 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed Apr 29 19:13:55 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:55 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04.d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" returned: 0 in 0.644s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-quobyte-d9c7c875-f191-4e3d-bd89-fd2b9a1740c5" released by "_delete_snapshot" :: held 3.304s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" released by "delete_snapshot" :: held 3.335s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:55 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Created reservations ['bac4623e-3d81-4884-bcf1-6a3f18b0c7d3', '265eea3d-d545-40f3-8f16-a524c0f28324', '28554244-72ce-417a-bd8c-31dbf6ff838d', '1b20ec70-49b8-4f5d-a93d-481768618bd5'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:55 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Delete snapshot completed successfully. Apr 29 19:13:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7115ed2b-6430-4a16-b3af-c967158b4151 tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-d9c7c875-f191-4e3d-bd89-fd2b9a1740c5-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:55 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" returned: 0 in 0.738s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:55 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa 1G Apr 29 19:13:55 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Acquiring lock "cinder-55518f85-ad33-43b3-b76d-bb970d3cce83-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Lock "cinder-55518f85-ad33-43b3-b76d-bb970d3cce83-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "cinder-ea74de63-1c7b-4334-8b4e-a1681e9c0f04-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-ea74de63-1c7b-4334-8b4e-a1681e9c0f04-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Acquiring lock "cinder-quobyte-55518f85-ad33-43b3-b76d-bb970d3cce83" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Lock "cinder-quobyte-55518f85-ad33-43b3-b76d-bb970d3cce83" acquired by "delete_volume" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6a15ea-69c9-4429-89b1-4aa17a104fe7]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" acquired by "delete_volume" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea1271b-54e6-4f38-8984-3271c009b3eb]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:56 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 Apr 29 19:13:56 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:56 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 Apr 29 19:13:56 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:56 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa 1G" returned: 0 in 0.873s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:56 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa Apr 29 19:13:56 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:57 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83" returned: 0 in 0.786s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:57 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83 Apr 29 19:13:57 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:57 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa" returned: 0 in 0.663s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:57 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa is being set with open permissions: ugo+rw Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:57 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" returned: 0 in 0.803s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:57 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa Apr 29 19:13:57 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:57 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04 Apr 29 19:13:57 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:57 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-55518f85-ad33-43b3-b76d-bb970d3cce83" returned: 0 in 0.627s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Lock "cinder-quobyte-55518f85-ad33-43b3-b76d-bb970d3cce83" released by "delete_volume" :: held 1.467s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG cinder.quota [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Created reservations ['3c729b69-9f45-4241-8bcc-3fc0f61c7f56', '0b36361c-a6ff-49de-91c0-d080bcca2894', 'c920596d-18ac-4d51-8c27-ea52efae1c49', '53bc79c4-1440-4440-b4c0-12bcfc6cc488'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:57 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa" returned: 0 in 0.639s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:57 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.info Apr 29 19:13:57 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:57 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" returned: 0 in 0.732s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:58 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-quobyte-ea74de63-1c7b-4334-8b4e-a1681e9c0f04" released by "delete_volume" :: held 1.598s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:58 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Created reservations ['4c476be2-f12d-4c84-bbaf-3dede04d94ae', '4bf80b22-7672-4965-b0df-bde4cd3959e0', 'daf94f96-8868-418f-9d32-86c433d224d0', 'dc732a89-3ff6-4e33-9408-16ec62dcdbc8'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:58 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:13:58 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:58 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.info" returned: 0 in 0.661s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:58 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.info is being set with open permissions: ugo+rw Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:58 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.info Apr 29 19:13:58 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:58 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.669s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG cinder.manager [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Deleted volume successfully. Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [req-c86b23bf-0dda-40e9-8343-76f38e35a7c3 req-afc43657-6d5a-42e1-a1c1-c1cf039f2f73 tempest-VolumesGetTestJSON-443470388 None] Lock "cinder-55518f85-ad33-43b3-b76d-bb970d3cce83-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:58 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.708s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:13:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Deleted volume successfully. Apr 29 19:13:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b71ab6a5-ddc3-45cc-910e-b4589d5ceaaf tempest-SnapshotsActionsTest-689829371 None] Lock "cinder-ea74de63-1c7b-4334-8b4e-a1681e9c0f04-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:13:59 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.info" returned: 0 in 0.712s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.429s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.726s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-860060459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a086859c-14a5-4d56-9b89-d700929ede21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8a255e5efc4991bfbd9e5d95d40f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:13:54Z,use_quota=True,user_id='c530f4e8b371416e8e357726d222f565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Creating volume a086859c-14a5-4d56-9b89-d700929ede21 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:13:59 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:13:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:13:59 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 1073741824 Apr 29 19:13:59 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:13:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-00662eaf-5626-481e-80d7-6b8fc8b2eba3 tempest-VolumesSnapshotListTestJSON-397637868 None] Create snapshot completed successfully Apr 29 19:14:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:00 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 1073741824" returned: 0 in 1.047s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:00 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 Apr 29 19:14:00 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:01 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21" returned: 0 in 0.714s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.820s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6931da12-5faf-47c5-a948-89dca5eb871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a086859c-14a5-4d56-9b89-d700929ede21', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab72bfe-5208-4034-ae3a-8c8cce86a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Creating offline snapshot d0efe2d5-6568-4d52-bb4c-2c344876d447 of volume 1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:14:01 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Volume volume-a086859c-14a5-4d56-9b89-d700929ede21 (a086859c-14a5-4d56-9b89-d700929ede21): created successfully Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab72bfe-5208-4034-ae3a-8c8cce86a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Flow 'volume_create_manager' (fc509f14-cb75-4b46-876a-efb78f42b1ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33c862e-a192-419e-836b-92956aacf555]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6208b533-a080-4eee-80d9-64c76a859ef3 tempest-VolumesTransfersV357Test-1466465143 None] Created volume successfully. Apr 29 19:14:01 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa Apr 29 19:14:01 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:02 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa" returned: 0 in 0.879s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:02 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 1G Apr 29 19:14:02 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Acquiring lock "cinder-a086859c-14a5-4d56-9b89-d700929ede21-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Lock "cinder-a086859c-14a5-4d56-9b89-d700929ede21-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Acquiring lock "cinder-quobyte-a086859c-14a5-4d56-9b89-d700929ede21" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Lock "cinder-quobyte-a086859c-14a5-4d56-9b89-d700929ede21" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9250059a-9163-46c2-bb3e-564874f235ae]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:02 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 Apr 29 19:14:02 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:03 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 1G" returned: 0 in 1.052s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:03 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 Apr 29 19:14:03 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:03 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21" returned: 0 in 0.891s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:03 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21 Apr 29 19:14:03 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:04 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447" returned: 0 in 0.847s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:04 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 is being set with open permissions: ugo+rw Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:04 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 Apr 29 19:14:04 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:04 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a086859c-14a5-4d56-9b89-d700929ede21" returned: 0 in 0.717s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Lock "cinder-quobyte-a086859c-14a5-4d56-9b89-d700929ede21" released by "delete_volume" :: held 1.663s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Created reservations ['48911c90-4d86-455d-a775-2b22ba8e49aa', '103288ee-502b-4d74-a827-fe959104bc4f', '3552fd81-2a8f-42bb-a90a-1af9b7c0d8ef', '686fc333-e465-486a-bdc9-b90976191e55'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:04 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:14:04 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:04 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447" returned: 0 in 0.798s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.754s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:04 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b5d1fe2c-705a-4f52-8cb6-a717a8d5df03 tempest-VolumesSnapshotListTestJSON-397637868 None] Create snapshot completed successfully Apr 29 19:14:05 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.826s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:05 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:14:05 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Deleted volume successfully. Apr 29 19:14:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-953fc4db-329d-4411-9392-eecb794b543f tempest-VolumesTransfersV357Test-742392961 None] Lock "cinder-a086859c-14a5-4d56-9b89-d700929ede21-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Creating offline snapshot 2f059de7-f65b-4a02-b958-0305eaf49b9d of volume 1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:14:05 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e822bd26-43fc-42c5-9ee5-08123d2c0c12]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:06 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 Apr 29 19:14:06 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:06 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447" returned: 0 in 0.867s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:06 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d 1G Apr 29 19:14:06 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:07 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d 1G" returned: 0 in 1.238s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:08 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d Apr 29 19:14:08 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:08 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d" returned: 0 in 0.909s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:08 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d is being set with open permissions: ugo+rw Apr 29 19:14:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:08 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d Apr 29 19:14:08 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:09 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-65beebb2-af48-4902-918f-6d546286fe54 tempest-GroupSnapshotsTest-1557513588 None] Group tempest-GroupSnapshotsTest-Group-70585820: creating Apr 29 19:14:09 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-65beebb2-af48-4902-918f-6d546286fe54 tempest-GroupSnapshotsTest-1557513588 None] Group tempest-GroupSnapshotsTest-Group-70585820: created successfully Apr 29 19:14:09 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-65beebb2-af48-4902-918f-6d546286fe54 tempest-GroupSnapshotsTest-1557513588 None] Create group completed successfully. Apr 29 19:14:09 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d" returned: 0 in 0.870s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.016s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:09 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e969bf20-2785-449d-88b9-e08a218e29d4 tempest-VolumesSnapshotListTestJSON-397637868 None] Create snapshot completed successfully Apr 29 19:14:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-2f059de7-f65b-4a02-b958-0305eaf49b9d-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-2f059de7-f65b-4a02-b958-0305eaf49b9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-quobyte-2f059de7-f65b-4a02-b958-0305eaf49b9d" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-2f059de7-f65b-4a02-b958-0305eaf49b9d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Deleting offline snapshot 2f059de7-f65b-4a02-b958-0305eaf49b9d of volume 1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] snapshot_file for this snap is: volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e1ba9c-c57e-47ea-b497-9cbf1937dcf7]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:11 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d Apr 29 19:14:11 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Flow 'volume_create_manager' (158c165b-c9da-48ad-ac6b-b8ae640da18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cede58-c626-4ac4-b691-7132bdfb1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=154,cinder:DELETE=12,cinder:SELECT=111,cinder:INSERT=31 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cede58-c626-4ac4-b691-7132bdfb1927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1435889839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffc039bf-2c5f-414e-b93b-66c6cf8dc099,host='devstack@QuobyteHD#QuobyteHD',id=844722c4-81a2-4194-aef8-1e2d06d39195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff39fec110b457b8af8586bdb121f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:11Z,use_quota=True,user_id='3dba5efe209846a0bba2c53467db5dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3530d126-cfd0-4a50-8b23-f15ef9ebafc4),volume_type_id=3530d126-cfd0-4a50-8b23-f15ef9ebafc4)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d591b00d-5aa6-484b-94fc-292853698a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d591b00d-5aa6-484b-94fc-292853698a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993d0e67-b74d-4587-8396-bfbc41d9a699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993d0e67-b74d-4587-8396-bfbc41d9a699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '844722c4-81a2-4194-aef8-1e2d06d39195', 'volume_name': 'volume-844722c4-81a2-4194-aef8-1e2d06d39195', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a18a5ce-44ab-4446-8186-24ee147767ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a18a5ce-44ab-4446-8186-24ee147767ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2003e160-e477-40a8-b172-cd4fab84685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:11 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Volume 844722c4-81a2-4194-aef8-1e2d06d39195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-844722c4-81a2-4194-aef8-1e2d06d39195', 'volume_size': 1} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ffc039bf-2c5f-414e-b93b-66c6cf8dc099,created_at=2026-04-29T17:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1435889839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ffc039bf-2c5f-414e-b93b-66c6cf8dc099,host='devstack@QuobyteHD#QuobyteHD',id=844722c4-81a2-4194-aef8-1e2d06d39195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff39fec110b457b8af8586bdb121f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:11Z,use_quota=True,user_id='3dba5efe209846a0bba2c53467db5dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3530d126-cfd0-4a50-8b23-f15ef9ebafc4),volume_type_id=3530d126-cfd0-4a50-8b23-f15ef9ebafc4)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Creating volume 844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:14:11 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:14:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:11 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 1073741824 Apr 29 19:14:11 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:12 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d" returned: 0 in 0.978s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[35635afb-5224-4a61-a9ba-3cce7153a943]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:12 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 Apr 29 19:14:12 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:12 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 1073741824" returned: 0 in 1.042s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Flow 'volume_create_manager' (5a17b563-233e-4fa7-a01f-3de05945f36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65721bd-7dc4-4a98-86fe-956c55e8c044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65721bd-7dc4-4a98-86fe-956c55e8c044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-853827775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc27d4b8-56d2-47f3-b7ee-d86d11e70736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc32c9fdf66a4ca68014361fd3037e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:12Z,use_quota=True,user_id='b62f8911ea5c431fac222c87b2176fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08b7b3a-9e90-4cbf-a9b7-374be96d9533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08b7b3a-9e90-4cbf-a9b7-374be96d9533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e111528-0395-4d4d-a210-d12ba89fc274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e111528-0395-4d4d-a210-d12ba89fc274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc27d4b8-56d2-47f3-b7ee-d86d11e70736', 'volume_name': 'volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2368fdc5-18d3-4215-9494-3a866abe9d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2368fdc5-18d3-4215-9494-3a866abe9d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ca26bc-fb77-4500-97fd-0734b4807e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Volume bc27d4b8-56d2-47f3-b7ee-d86d11e70736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736', 'volume_size': 1} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:12 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 Apr 29 19:14:12 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Flow 'volume_create_manager' (59dd7797-2ccc-4c43-80d9-40ff3dad959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897e339f-b679-40c9-a9ca-72094f6089a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897e339f-b679-40c9-a9ca-72094f6089a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1827530566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58253e84c2974e46a1735a3f092cbef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:13Z,use_quota=True,user_id='68535c15c34b45599a3becc29d395e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3b8f94-653a-48b1-823e-ab3eb3dfc8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3b8f94-653a-48b1-823e-ab3eb3dfc8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9eb04f1-0693-4ed1-ac29-249f3ce8ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9eb04f1-0693-4ed1-ac29-249f3ce8ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9', 'volume_name': 'volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f00dba-579e-4c72-a695-d62564f775a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f00dba-579e-4c72-a695-d62564f775a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7261d79-cca7-4ef4-87ba-16db3f99d1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:12 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Volume 2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9', 'volume_size': 1} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:12 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447" returned: 0 in 0.884s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:12 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d Apr 29 19:14:12 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:13 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195" returned: 0 in 0.631s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-853827775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc27d4b8-56d2-47f3-b7ee-d86d11e70736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc32c9fdf66a4ca68014361fd3037e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:12Z,use_quota=True,user_id='b62f8911ea5c431fac222c87b2176fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Creating volume bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:14:13 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:13 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 1073741824 Apr 29 19:14:13 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2003e160-e477-40a8-b172-cd4fab84685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-844722c4-81a2-4194-aef8-1e2d06d39195', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb2d11a-e723-467a-a2c0-d1dab1add672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:13 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Volume volume-844722c4-81a2-4194-aef8-1e2d06d39195 (844722c4-81a2-4194-aef8-1e2d06d39195): created successfully Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb2d11a-e723-467a-a2c0-d1dab1add672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Flow 'volume_create_manager' (158c165b-c9da-48ad-ac6b-b8ae640da18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:13 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f37e2fc2-9d4c-440d-8154-6cab0f5cef37 tempest-GroupSnapshotsTest-1557513588 None] Created volume successfully. Apr 29 19:14:13 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] GroupSnapshot f8cb331e-2b80-45d0-86e5-78df4f65a865: creating. Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Group snapshot f8cb331e-2b80-45d0-86e5-78df4f65a865: creating. {{(pid=84523) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:13 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d" returned: 0 in 0.865s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:13 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d Apr 29 19:14:13 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:13 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 1073741824" returned: 0 in 0.824s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:14 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 Apr 29 19:14:14 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:14 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.2f059de7-f65b-4a02-b958-0305eaf49b9d" returned: 0 in 0.608s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-2f059de7-f65b-4a02-b958-0305eaf49b9d" released by "_delete_snapshot" :: held 3.483s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" released by "delete_snapshot" :: held 3.518s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Created reservations ['350b0d8f-8763-4755-b509-782651418da0', '984e19b4-f114-4237-a30d-a59a0bba9c9f', '39d839c0-8a63-447e-a923-bb4a7eea648b', '123864b3-ec8f-4779-951a-b1edf7cc3f42'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:14 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Delete snapshot completed successfully. Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d236db9-c57f-4768-9f85-2bbbd37cbfff tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-2f059de7-f65b-4a02-b958-0305eaf49b9d-delete_snapshot" released by "delete_snapshot" :: held 3.672s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:14 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" returned: 0 in 0.598s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.707s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1827530566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58253e84c2974e46a1735a3f092cbef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:13Z,use_quota=True,user_id='68535c15c34b45599a3becc29d395e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Creating volume 2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:14:14 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:14 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 1073741824 Apr 29 19:14:14 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ca26bc-fb77-4500-97fd-0734b4807e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10925ca-412c-4156-8573-1c408451d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:14 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Volume volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 (bc27d4b8-56d2-47f3-b7ee-d86d11e70736): created successfully Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10925ca-412c-4156-8573-1c408451d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Flow 'volume_create_manager' (5a17b563-233e-4fa7-a01f-3de05945f36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:14 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b73d04e7-238e-414e-8c62-aefb7331e1fa tempest-VolumesCloneTest-776966064 None] Created volume successfully. Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-d0efe2d5-6568-4d52-bb4c-2c344876d447-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-d0efe2d5-6568-4d52-bb4c-2c344876d447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-quobyte-d0efe2d5-6568-4d52-bb4c-2c344876d447" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-d0efe2d5-6568-4d52-bb4c-2c344876d447" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Deleting offline snapshot d0efe2d5-6568-4d52-bb4c-2c344876d447 of volume 1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] snapshot_file for this snap is: volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f44d081-cc6c-4d2c-a35c-e7090d06b22d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:15 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 1073741824" returned: 0 in 0.866s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:15 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 Apr 29 19:14:15 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:15 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 Apr 29 19:14:15 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Flow 'volume_create_manager' (2c0a10db-f000-4161-9457-5917398152ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63540205-1db9-4cc4-80ee-99d18028813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63540205-1db9-4cc4-80ee-99d18028813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1091030636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201f52eb-2004-4ccf-b3c4-a81ddb63d9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc32c9fdf66a4ca68014361fd3037e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bc27d4b8-56d2-47f3-b7ee-d86d11e70736,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:16Z,use_quota=True,user_id='b62f8911ea5c431fac222c87b2176fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210541e4-13bd-495b-86d7-aa4a36eb568b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210541e4-13bd-495b-86d7-aa4a36eb568b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ef9d3d-1d13-4219-b21d-d409bf49f739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:16 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" returned: 0 in 0.669s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:14:16 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.593s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447" returned: 0 in 0.812s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ef9d3d-1d13-4219-b21d-d409bf49f739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '201f52eb-2004-4ccf-b3c4-a81ddb63d9c3', 'volume_name': 'volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3', 'volume_size': 2, 'source_volid': 'bc27d4b8-56d2-47f3-b7ee-d86d11e70736', 'source_volstatus': 'available'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0541a8-29f9-4fc0-b0a1-bf4cc409792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0541a8-29f9-4fc0-b0a1-bf4cc409792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca833095-bb65-4c21-b29b-8c778bbb1e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:16 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Volume 201f52eb-2004-4ccf-b3c4-a81ddb63d9c3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3', 'volume_size': 2, 'source_volid': 'bc27d4b8-56d2-47f3-b7ee-d86d11e70736', 'source_volstatus': 'available'} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Creating offline snapshot 972680b9-5600-4a5b-abb3-89e98a3f1883 of volume 844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a09df0-0979-4f65-b906-54cdd1dbed4b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7261d79-cca7-4ef4-87ba-16db3f99d1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399c4d95-b725-4868-8343-1c81e2e996e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95fbd30-69ca-4c5e-a859-3e1d1b0eef82]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:16 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Volume volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 (2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9): created successfully Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399c4d95-b725-4868-8343-1c81e2e996e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Flow 'volume_create_manager' (59dd7797-2ccc-4c43-80d9-40ff3dad959e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:16 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1c23b2a9-4c14-4b99-a747-82fea2dc3c2b tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Created volume successfully. Apr 29 19:14:16 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa Apr 29 19:14:16 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:16 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 Apr 29 19:14:16 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:17 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa" returned: 0 in 0.755s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:17 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 Apr 29 19:14:17 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:17 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195" returned: 0 in 0.772s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:17 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 1G Apr 29 19:14:17 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:17 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447" returned: 0 in 0.813s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:17 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 1G" returned: 0 in 0.787s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844722c4-81a2-4194-aef8-1e2d06d39195 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:17 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447 Apr 29 19:14:17 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:17 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844722c4-81a2-4194-aef8-1e2d06d39195 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 Apr 29 19:14:17 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:18 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.d0efe2d5-6568-4d52-bb4c-2c344876d447" returned: 0 in 0.678s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-d0efe2d5-6568-4d52-bb4c-2c344876d447" released by "_delete_snapshot" :: held 3.217s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" released by "delete_snapshot" :: held 3.245s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:18 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844722c4-81a2-4194-aef8-1e2d06d39195 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883" returned: 0 in 0.718s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:18 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:14:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:18 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 Apr 29 19:14:18 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:18 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Created reservations ['ebdc3944-9162-4418-b93b-888cb6fc64c4', '590e2784-af9f-4a6d-93ef-8b24707f62bb', '2cf9e4b4-ca78-4cc6-8c95-4f207ba5b18a', 'c5acddc2-6678-4c33-8c0a-73f71552294d'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Delete snapshot completed successfully. Apr 29 19:14:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c8031719-edb9-42b8-af1d-2f3323336b96 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-d0efe2d5-6568-4d52-bb4c-2c344876d447-delete_snapshot" released by "delete_snapshot" :: held 3.409s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:19 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883" returned: 0 in 0.620s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:19 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.info Apr 29 19:14:19 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-8e1e05fc-4267-41c2-857f-8f9f556df6fa-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-8e1e05fc-4267-41c2-857f-8f9f556df6fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-quobyte-8e1e05fc-4267-41c2-857f-8f9f556df6fa" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-8e1e05fc-4267-41c2-857f-8f9f556df6fa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Deleting offline snapshot 8e1e05fc-4267-41c2-857f-8f9f556df6fa of volume 1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] snapshot_file for this snap is: volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7864b8-d3d7-4ced-916a-719d067ca25a]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:19 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa Apr 29 19:14:19 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:19 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.info" returned: 0 in 0.632s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:19 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:14:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:19 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.info Apr 29 19:14:19 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:20 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa" returned: 0 in 0.717s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[862fc55c-cd5f-4781-953f-8548c55d0d84]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:20 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.info" returned: 0 in 0.598s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.306s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.194s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:20 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Cloning volume bc27d4b8-56d2-47f3-b7ee-d86d11e70736 to volume 201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 Apr 29 19:14:20 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed Apr 29 19:14:20 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Creating offline snapshot 26f7b6f4-e2fc-4898-9d7a-6322768ceacb of volume bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe6fa1a-04ae-485d-9b99-772d67070ee9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:20 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-53417049-d016-4461-b9ce-635869fec9e8 tempest-GroupSnapshotsTest-1557513588 None] group_snapshot f8cb331e-2b80-45d0-86e5-78df4f65a865: created successfully Apr 29 19:14:20 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 Apr 29 19:14:20 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:21 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" returned: 0 in 0.700s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:21 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa Apr 29 19:14:21 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:21 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" returned: 0 in 0.735s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:21 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb 1G Apr 29 19:14:21 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:21 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa" returned: 0 in 0.696s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:21 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa Apr 29 19:14:21 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:22 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb 1G" returned: 0 in 0.843s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:22 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb Apr 29 19:14:22 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:22 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed.8e1e05fc-4267-41c2-857f-8f9f556df6fa" returned: 0 in 0.684s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-8e1e05fc-4267-41c2-857f-8f9f556df6fa" released by "_delete_snapshot" :: held 2.926s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" released by "delete_snapshot" :: held 2.950s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Created reservations ['e4399a21-4aca-4629-9eb4-5681f9ccabf6', 'e63a0fb3-8a0b-411e-baf3-3086a8b3620c', '67eee4ea-1eb2-4ac0-996f-5f9990578ecf', 'bbc02e0d-c98a-4d09-b0aa-2fd448867413'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:22 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Delete snapshot completed successfully. Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4a10cc2e-facd-44df-93a1-94371b2adb0e tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-8e1e05fc-4267-41c2-857f-8f9f556df6fa-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:22 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb" returned: 0 in 0.688s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:22 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb is being set with open permissions: ugo+rw Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:22 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb Apr 29 19:14:22 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f149a4e-3a8d-4f4f-ae24-d0a14bab337c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:23 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed Apr 29 19:14:23 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:23 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb" returned: 0 in 0.605s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:23 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.info Apr 29 19:14:23 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:23 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" returned: 0 in 0.715s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:23 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed Apr 29 19:14:23 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:24 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.info" returned: 0 in 0.590s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:24 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.info is being set with open permissions: ugo+rw Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:24 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.info Apr 29 19:14:24 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:24 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" returned: 0 in 0.603s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-quobyte-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed" released by "delete_volume" :: held 1.386s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Created reservations ['647a985f-88a0-4395-94e9-f0ba2c655158', '67bc59a5-b744-4794-8120-59835c4170ee', 'e1077305-231c-4bd7-8494-83ab8fb96321', 'f231d3c2-58e0-4b22-b4db-95f9c0ad8beb'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:24 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:14:24 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:24 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.info" returned: 0 in 0.575s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Acquiring lock "cinder-quobyte-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Lock "cinder-quobyte-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] snapshot: 26f7b6f4-e2fc-4898-9d7a-6322768ceacb, volume: 201f52eb-2004-4ccf-b3c4-a81ddb63d9c3, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f847882-5e82-4991-85ac-5c33fb43088a]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:24 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb Apr 29 19:14:24 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:25 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.627s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:14:25 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Deleted volume successfully. Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f1c837f9-d406-4fd6-acac-8119f563f313 tempest-VolumesSnapshotListTestJSON-397637868 None] Lock "cinder-1e9bb5ca-8a32-4c2d-a357-7d90a76098ed-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:25 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb" returned: 0 in 0.733s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b4d68c-7f54-4722-8ab9-e3d3790af79f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:25 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 Apr 29 19:14:25 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:26 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" returned: 0 in 0.775s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:26 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:14:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:26 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 Apr 29 19:14:26 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (cefb9283-db48-49f0-8f83-c556b4159830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2012a3-5ccc-4184-893f-3272a0d48ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2012a3-5ccc-4184-893f-3272a0d48ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571192993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3f5b87-1230-485a-9470-28c107958f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:28Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67cb16a-9171-4d66-93c7-d120b22f9796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67cb16a-9171-4d66-93c7-d120b22f9796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9546a-1f48-4910-a266-12514f1f9464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c9546a-1f48-4910-a266-12514f1f9464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af3f5b87-1230-485a-9470-28c107958f09', 'volume_name': 'volume-af3f5b87-1230-485a-9470-28c107958f09', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c169f5e5-81cb-4a48-8ae5-f48c9c3f9d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c169f5e5-81cb-4a48-8ae5-f48c9c3f9d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e42def5-a9c3-47b1-b00f-dadbf439f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:28 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume af3f5b87-1230-485a-9470-28c107958f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af3f5b87-1230-485a-9470-28c107958f09', 'volume_size': 1} Apr 29 19:14:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:14:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:29 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:14:29 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:30 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.194s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:14:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:14:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:14:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:14:31 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" returned: 0 in 5.168s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:31 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a628c0d6-cc8a-42cd-8cb9-a91785cb7271]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:31 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 Apr 29 19:14:31 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:32 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" returned: 0 in 0.855s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:14:32 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Converted 1024.00 MB image at 198.12 MB/s Apr 29 19:14:32 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 is being set with open permissions: ugo+rw Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:32 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 Apr 29 19:14:32 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:32 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" returned: 0 in 0.600s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Lock "cinder-quobyte-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" released by "_copy_volume_from_snapshot" :: held 8.226s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Acquiring lock "cinder-quobyte-26f7b6f4-e2fc-4898-9d7a-6322768ceacb" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Lock "cinder-quobyte-26f7b6f4-e2fc-4898-9d7a-6322768ceacb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Deleting offline snapshot 26f7b6f4-e2fc-4898-9d7a-6322768ceacb of volume bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] snapshot_file for this snap is: volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbb272a-0a49-485d-8303-46be153b7a4d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:33 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb Apr 29 19:14:33 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:33 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb" returned: 0 in 0.705s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a3a90b-978c-44db-9275-9ad4fda59ccc]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:33 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 Apr 29 19:14:33 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:34 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" returned: 0 in 0.695s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:34 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb Apr 29 19:14:34 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:35 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb" returned: 0 in 0.670s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:35 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb Apr 29 19:14:35 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:35 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736.26f7b6f4-e2fc-4898-9d7a-6322768ceacb" returned: 0 in 0.598s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Lock "cinder-quobyte-26f7b6f4-e2fc-4898-9d7a-6322768ceacb" released by "_delete_snapshot" :: held 2.771s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.248s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.460s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Creating offline snapshot 7595f68c-e9f8-4097-a281-1ccc42931c1e of volume 2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca833095-bb65-4c21-b29b-8c778bbb1e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3', 'volume_size': 2, 'source_volid': 'bc27d4b8-56d2-47f3-b7ee-d86d11e70736', 'source_volstatus': 'available'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19a29d8-5454-4d92-a9a3-d2575a2827f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d041f1-e255-449d-aee8-f0b627240fb0]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:35 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Volume volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 (201f52eb-2004-4ccf-b3c4-a81ddb63d9c3): created successfully Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19a29d8-5454-4d92-a9a3-d2575a2827f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Flow 'volume_create_manager' (2c0a10db-f000-4161-9457-5917398152ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:35 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-03080fcb-d9bc-461d-bdee-bf25976963e6 tempest-VolumesCloneTest-776966064 None] Created volume successfully. Apr 29 19:14:35 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 Apr 29 19:14:35 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:36 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" returned: 0 in 0.717s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:36 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e 1G Apr 29 19:14:36 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Acquiring lock "cinder-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Lock "cinder-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Acquiring lock "cinder-quobyte-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Lock "cinder-quobyte-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ca475c-17a2-44aa-a080-b8a86aae7a0b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:37 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 Apr 29 19:14:37 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:37 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e 1G" returned: 0 in 0.748s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:37 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e Apr 29 19:14:37 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:37 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" returned: 0 in 0.737s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:37 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3 Apr 29 19:14:37 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:37 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e" returned: 0 in 0.649s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:37 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e is being set with open permissions: ugo+rw Apr 29 19:14:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:37 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e Apr 29 19:14:37 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:38 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" returned: 0 in 0.621s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Lock "cinder-quobyte-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3" released by "delete_volume" :: held 1.404s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=109,cinder:UPDATE=124,cinder:INSERT=35,cinder:DELETE=11 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Created reservations ['6cd4a119-9c7d-451f-b5af-712aae520b48', 'e67352f8-c73e-4a8b-92e8-da445f53e772', '3a3fc4bf-5f1e-404b-8e81-f9f3c2ba5710', 'f1909101-5fd2-41a7-a857-9798d9a60808'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:38 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e" returned: 0 in 0.633s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:38 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.info Apr 29 19:14:38 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:38 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:14:38 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:39 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:39 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.581s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.info" returned: 0 in 0.605s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:39 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.info is being set with open permissions: ugo+rw Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:39 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Deleted volume successfully. Apr 29 19:14:39 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.info Apr 29 19:14:39 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-511d5093-e107-4c7f-87fc-250311867611 tempest-VolumesCloneTest-776966064 None] Lock "cinder-201f52eb-2004-4ccf-b3c4-a81ddb63d9c3-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Acquiring lock "cinder-bc27d4b8-56d2-47f3-b7ee-d86d11e70736-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Lock "cinder-bc27d4b8-56d2-47f3-b7ee-d86d11e70736-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Acquiring lock "cinder-quobyte-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Lock "cinder-quobyte-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6374cfb6-d6cb-4dcb-b3e6-12cb2d2636f9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:39 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 Apr 29 19:14:39 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:39 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.info" returned: 0 in 0.626s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 17.772s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-972680b9-5600-4a5b-abb3-89e98a3f1883-67c0cbeb-6816-4909-9cee-05a1334f05d9" by "_create_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:39 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-eedf2300-aa0a-4d48-b77b-d110b866a5fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Create snapshot completed successfully Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-972680b9-5600-4a5b-abb3-89e98a3f1883-67c0cbeb-6816-4909-9cee-05a1334f05d9" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Creating volume 67c0cbeb-6816-4909-9cee-05a1334f05d9 from snapshot 972680b9-5600-4a5b-abb3-89e98a3f1883 {{(pid=84523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-67c0cbeb-6816-4909-9cee-05a1334f05d9" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-67c0cbeb-6816-4909-9cee-05a1334f05d9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] snapshot: 972680b9-5600-4a5b-abb3-89e98a3f1883, volume: 67c0cbeb-6816-4909-9cee-05a1334f05d9, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df3edc-851d-4766-8e46-15d4f060ea9e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:40 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 Apr 29 19:14:40 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:40 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" returned: 0 in 0.746s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:40 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736 Apr 29 19:14:40 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:40 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883" returned: 0 in 0.751s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-844722c4-81a2-4194-aef8-1e2d06d39195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b902bc6-3375-4088-a884-75bb4a45e627]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:40 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" returned: 0 in 0.603s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Lock "cinder-quobyte-bc27d4b8-56d2-47f3-b7ee-d86d11e70736" released by "delete_volume" :: held 1.432s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Created reservations ['52f5c4ed-193d-4d00-ab94-8f84b6ba80c4', '182aac54-e031-4d9d-88d0-ff05df3139a0', '9cbbd04a-ef08-4860-ad98-25db7f25e309', '27ae8d12-89a6-4413-a97e-5e800c5f0dec'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:40 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 Apr 29 19:14:40 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "cinder-7595f68c-e9f8-4097-a281-1ccc42931c1e-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:40 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:14:40 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-7595f68c-e9f8-4097-a281-1ccc42931c1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "cinder-quobyte-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-quobyte-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "cinder-quobyte-7595f68c-e9f8-4097-a281-1ccc42931c1e" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-quobyte-7595f68c-e9f8-4097-a281-1ccc42931c1e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Deleting offline snapshot 7595f68c-e9f8-4097-a281-1ccc42931c1e of volume 2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] snapshot_file for this snap is: volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce24c6-40f9-40fe-b1ea-4935bb7cfdf8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:41 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e Apr 29 19:14:41 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:41 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195" returned: 0 in 0.893s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:41 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.729s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:14:41 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Deleted volume successfully. Apr 29 19:14:41 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 Apr 29 19:14:41 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4c44a4e9-fb9e-4e0c-8955-0e1aac4bebe5 tempest-VolumesCloneTest-776966064 None] Lock "cinder-bc27d4b8-56d2-47f3-b7ee-d86d11e70736-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:41 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e" returned: 0 in 0.898s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:42 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[661b894f-58b8-4972-819d-c5d084c3678c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:42 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 Apr 29 19:14:42 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:43 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" returned: 0 in 1.343s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:43 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e Apr 29 19:14:43 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:44 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e" returned: 0 in 1.420s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:44 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e Apr 29 19:14:44 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:45 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9.7595f68c-e9f8-4097-a281-1ccc42931c1e" returned: 0 in 1.095s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-quobyte-7595f68c-e9f8-4097-a281-1ccc42931c1e" released by "_delete_snapshot" :: held 4.992s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-quobyte-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" released by "delete_snapshot" :: held 5.032s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:46 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Created reservations ['113d5b5b-65ea-4191-a668-736c2871fff3', '14769a4c-50e2-48af-ad2e-328a83deb351', '7af4062f-7682-4159-be01-5852daf9b7fb', 'a656715b-686d-4383-8d0f-d1f01f26aa59'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:46 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Delete snapshot completed successfully. Apr 29 19:14:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88457423-3081-49e9-ad2e-f043e3b6fa88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-7595f68c-e9f8-4097-a281-1ccc42931c1e-delete_snapshot" released by "delete_snapshot" :: held 5.468s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "cinder-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "cinder-quobyte-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-quobyte-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" acquired by "delete_volume" :: waited 0.039s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9222e828-292f-4f06-b053-2bb8f89a3850]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:47 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 Apr 29 19:14:47 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:47 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9" returned: 0 in 6.206s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eeda9d-475b-4b1a-bcf2-ae45e052ce35]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Flow 'volume_create_manager' (2062345c-e975-484e-a9b6-e54efed0db92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df231a2-3e0d-44d8-9241-e6c78f0ba7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df231a2-3e0d-44d8-9241-e6c78f0ba7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1599176639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20bdd5c-9b3f-4808-b581-37b32c940a43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56304aa04ce44520b1a1d77f58838098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:48Z,use_quota=True,user_id='207143e578b649978a749b0d2ead308a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d099f498-c4b2-41d0-bd2e-f0d3f6f4e9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d099f498-c4b2-41d0-bd2e-f0d3f6f4e9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:47 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 Apr 29 19:14:47 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9486d02b-8f5c-4da3-967e-94e0eefd0d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9486d02b-8f5c-4da3-967e-94e0eefd0d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f20bdd5c-9b3f-4808-b581-37b32c940a43', 'volume_name': 'volume-f20bdd5c-9b3f-4808-b581-37b32c940a43', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c82e59-fca9-43e3-a6ee-2d7b9eaeda9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c82e59-fca9-43e3-a6ee-2d7b9eaeda9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fde96c-80dd-45e0-a847-56112f576ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:48 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Volume f20bdd5c-9b3f-4808-b581-37b32c940a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f20bdd5c-9b3f-4808-b581-37b32c940a43', 'volume_size': 1} Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:48 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" returned: 0 in 0.976s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:48 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9 Apr 29 19:14:48 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:48 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195" returned: 0 in 0.915s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:14:48 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Converted 1024.00 MB image at 164.96 MB/s Apr 29 19:14:48 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:48 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 Apr 29 19:14:48 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:48 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" returned: 0 in 0.635s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-quobyte-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9" released by "delete_volume" :: held 1.788s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Created reservations ['28049211-58d0-45f5-a782-4ce7fbcf160c', 'c0d95669-e43c-4cca-af8c-46a29bdfee46', '0ae138e5-aef4-4c2a-adf4-25aeaeb5c36a', 'e100220c-28ba-4f2d-89ec-fcae41bfe49a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:49 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:14:49 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:49 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9" returned: 0 in 0.657s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-67c0cbeb-6816-4909-9cee-05a1334f05d9" released by "_copy_volume_from_snapshot" :: held 9.535s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-972680b9-5600-4a5b-abb3-89e98a3f1883-67c0cbeb-6816-4909-9cee-05a1334f05d9" released by "_create_volume_from_snapshot" :: held 9.581s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.614s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.771s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571192993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3f5b87-1230-485a-9470-28c107958f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:28Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Creating volume af3f5b87-1230-485a-9470-28c107958f09 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:14:49 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:49 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 1073741824 Apr 29 19:14:49 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:49 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3bd5d9ab-1697-46b5-bd5f-372692561cd3 tempest-GroupSnapshotsTest-1557513588 None] Create group from source-snapshot-f8cb331e-2b80-45d0-86e5-78df4f65a865 completed successfully. Apr 29 19:14:49 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.674s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:14:49 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Deleted volume successfully. Apr 29 19:14:49 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f588fa6-9ce8-4d51-9ddb-819199ebcd29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1946437704 None] Lock "cinder-2b56bf42-bdda-4ecd-8fc6-5a2f66e6f6f9-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-67c0cbeb-6816-4909-9cee-05a1334f05d9" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-67c0cbeb-6816-4909-9cee-05a1334f05d9" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:50 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc133d-43ee-4bea-993c-4d6f413266a4]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:50 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 1073741824" returned: 0 in 0.933s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:50 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 Apr 29 19:14:50 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:50 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 Apr 29 19:14:50 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:51 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9" returned: 0 in 0.789s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:51 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9 Apr 29 19:14:51 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:51 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09" returned: 0 in 0.692s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1599176639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20bdd5c-9b3f-4808-b581-37b32c940a43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56304aa04ce44520b1a1d77f58838098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:48Z,use_quota=True,user_id='207143e578b649978a749b0d2ead308a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Creating volume f20bdd5c-9b3f-4808-b581-37b32c940a43 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:14:51 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e42def5-a9c3-47b1-b00f-dadbf439f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af3f5b87-1230-485a-9470-28c107958f09', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1a25b3-c8f6-49dd-8db3-3100028b12d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:51 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 1073741824 Apr 29 19:14:51 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume volume-af3f5b87-1230-485a-9470-28c107958f09 (af3f5b87-1230-485a-9470-28c107958f09): created successfully Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1a25b3-c8f6-49dd-8db3-3100028b12d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (cefb9283-db48-49f0-8f83-c556b4159830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:51 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-81ce6f53-85b0-48cb-af5f-f6ed7690d54a tempest-CreateVolumesFromSnapshotTest-360175836 None] Created volume successfully. Apr 29 19:14:51 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-67c0cbeb-6816-4909-9cee-05a1334f05d9" returned: 0 in 0.667s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-67c0cbeb-6816-4909-9cee-05a1334f05d9" released by "delete_volume" :: held 1.515s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:51 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['d5a8415e-a2b0-4be7-8a95-1a542dbfb767'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:51 devstack cinder-volume[84523]: WARNING cinder.quota [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1631896956 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1631896956, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:14:51 devstack cinder-volume[84523]: WARNING cinder.quota [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1631896956 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1631896956, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['80b32d31-29f3-4ee0-9d39-f0b2e1eb8b2f', '8aa8b074-97a4-4b1b-a898-ce3bc698414d', '61818cc7-4875-4816-ba1b-ebfeba8df5e9', '98f674ff-8c10-4a74-8bb9-79cae9668c43'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:52 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 1073741824" returned: 0 in 1.045s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:52 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:14:52 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:52 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 Apr 29 19:14:52 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:52 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] group_snapshot f8cb331e-2b80-45d0-86e5-78df4f65a865: deleting Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] group_snapshot f8cb331e-2b80-45d0-86e5-78df4f65a865: deleting {{(pid=84523) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-844722c4-81a2-4194-aef8-1e2d06d39195" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-844722c4-81a2-4194-aef8-1e2d06d39195" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-972680b9-5600-4a5b-abb3-89e98a3f1883" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-972680b9-5600-4a5b-abb3-89e98a3f1883" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Deleting offline snapshot 972680b9-5600-4a5b-abb3-89e98a3f1883 of volume 844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] snapshot_file for this snap is: volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b11fe8-fc7b-4a68-98fd-8e13aeecadee]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:52 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43" returned: 0 in 0.674s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.853s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Creating offline snapshot 49716314-b35b-404e-a683-6a23e6da6c95 of volume af3f5b87-1230-485a-9470-28c107958f09 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:14:52 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fde96c-80dd-45e0-a847-56112f576ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f20bdd5c-9b3f-4808-b581-37b32c940a43', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:52 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 Apr 29 19:14:52 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c23484-ccac-4d38-904a-d85a60e663ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.792s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d62b83-dad8-4fc9-b6a6-16dbb33ad4b1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:52 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a8f231e2-6977-46d9-a63e-5d6c54317f17 tempest-GroupSnapshotsTest-1557513588 None] Delete group completed successfully. Apr 29 19:14:53 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Volume volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 (f20bdd5c-9b3f-4808-b581-37b32c940a43): created successfully Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c23484-ccac-4d38-904a-d85a60e663ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Flow 'volume_create_manager' (2062345c-e975-484e-a9b6-e54efed0db92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-401afa5e-9e69-4a0c-8158-fb905f9c362a tempest-VolumesListTestJSON-58674277 None] Created volume successfully. Apr 29 19:14:53 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 Apr 29 19:14:53 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:53 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883" returned: 0 in 0.872s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-844722c4-81a2-4194-aef8-1e2d06d39195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[288e48ec-2fcb-4447-8fc4-dd7cc278e7e9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:53 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09" returned: 0 in 0.867s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:53 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 1G Apr 29 19:14:53 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Flow 'volume_create_manager' (df5b7e72-9585-4c28-b7e5-0aac635e6c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:53 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 Apr 29 19:14:53 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3189a74f-417e-4cd4-9b0e-75c73b758455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3189a74f-417e-4cd4-9b0e-75c73b758455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-862721676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17685ff-4095-47bf-a533-3e967951b149,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56304aa04ce44520b1a1d77f58838098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:54Z,use_quota=True,user_id='207143e578b649978a749b0d2ead308a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de493dc-0b53-46b7-bcd4-df3026c992d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de493dc-0b53-46b7-bcd4-df3026c992d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f774dfce-48ce-4367-b2d7-e9b6ae01a100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f774dfce-48ce-4367-b2d7-e9b6ae01a100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17685ff-4095-47bf-a533-3e967951b149', 'volume_name': 'volume-d17685ff-4095-47bf-a533-3e967951b149', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb155f3-d3a7-4a8f-9df1-fe92f8a2b251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb155f3-d3a7-4a8f-9df1-fe92f8a2b251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc18a51d-b6ea-4cb2-b7dd-d82d27156741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:54 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Volume d17685ff-4095-47bf-a533-3e967951b149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17685ff-4095-47bf-a533-3e967951b149', 'volume_size': 1} Apr 29 19:14:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:54 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195" returned: 0 in 0.812s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:54 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 Apr 29 19:14:54 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:54 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 1G" returned: 0 in 0.870s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3f5b87-1230-485a-9470-28c107958f09 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:54 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3f5b87-1230-485a-9470-28c107958f09 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 Apr 29 19:14:54 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:55 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883" returned: 0 in 0.744s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:55 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883 Apr 29 19:14:55 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:55 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af3f5b87-1230-485a-9470-28c107958f09 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95" returned: 0 in 0.717s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:55 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 is being set with open permissions: ugo+rw Apr 29 19:14:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:55 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 Apr 29 19:14:55 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:56 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195.972680b9-5600-4a5b-abb3-89e98a3f1883" returned: 0 in 0.690s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-972680b9-5600-4a5b-abb3-89e98a3f1883" released by "_delete_snapshot" :: held 3.268s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-844722c4-81a2-4194-aef8-1e2d06d39195" released by "delete_snapshot" :: held 3.306s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:56 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95" returned: 0 in 0.672s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:56 devstack cinder-volume[84523]: WARNING cinder.quota [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1631896956 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1631896956, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:14:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:56 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.info Apr 29 19:14:56 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:56 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['418c519f-1d30-40a2-8d63-20c1ceacab15', '0587ebff-6d6b-48a0-8455-ef70960ef8e0', '22fe2cae-b4a5-43af-a4d4-6e98e345fe63', 'c972c526-deb8-41a7-87e3-5a34e2aa6932'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:56 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9b937673-b6cc-4d77-a671-59fdeab0d28d tempest-GroupSnapshotsTest-1557513588 None] group_snapshot f8cb331e-2b80-45d0-86e5-78df4f65a865: deleted successfully Apr 29 19:14:56 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.info" returned: 0 in 0.682s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:56 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.info is being set with open permissions: ugo+rw Apr 29 19:14:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:56 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.info Apr 29 19:14:56 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-844722c4-81a2-4194-aef8-1e2d06d39195" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-844722c4-81a2-4194-aef8-1e2d06d39195" acquired by "delete_volume" :: waited 0.038s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea94c22b-14f8-4027-a526-68e472dd1689]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:57 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.info" returned: 0 in 0.748s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.668s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:57 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 Apr 29 19:14:57 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.615s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-862721676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17685ff-4095-47bf-a533-3e967951b149,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56304aa04ce44520b1a1d77f58838098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:54Z,use_quota=True,user_id='207143e578b649978a749b0d2ead308a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Creating volume d17685ff-4095-47bf-a533-3e967951b149 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:14:57 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:14:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:57 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 1073741824 Apr 29 19:14:57 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:57 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4a89006d-ba9c-47e0-ae27-ebcf2e09a4de tempest-CreateVolumesFromSnapshotTest-360175836 None] Create snapshot completed successfully Apr 29 19:14:58 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195" returned: 0 in 0.773s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:58 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195 Apr 29 19:14:58 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:58 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 1073741824" returned: 0 in 0.867s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:58 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 Apr 29 19:14:58 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (3e5f04e8-1966-4a5b-8ecb-02abc568a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3eaeed2-8f98-46db-b6e8-0fa6beaaecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3eaeed2-8f98-46db-b6e8-0fa6beaaecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137196265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e62172-d1d3-4c18-b9d3-c2e8d182b051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:59Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ae30c4-584f-4ca7-90bf-08a83d4e618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ae30c4-584f-4ca7-90bf-08a83d4e618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960500b8-a89e-4f88-a41d-cd4f8b7f1aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960500b8-a89e-4f88-a41d-cd4f8b7f1aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e62172-d1d3-4c18-b9d3-c2e8d182b051', 'volume_name': 'volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c89d4c-0d54-4d17-baec-4d55c6aa546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c89d4c-0d54-4d17-baec-4d55c6aa546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca8a057-08db-4c4b-9f36-298d69dcf897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume 95e62172-d1d3-4c18-b9d3-c2e8d182b051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051', 'volume_size': 1} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:59 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-844722c4-81a2-4194-aef8-1e2d06d39195" returned: 0 in 0.990s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-844722c4-81a2-4194-aef8-1e2d06d39195" released by "delete_volume" :: held 1.917s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (45d52c66-3d26-4638-8975-7bc4366f5284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b94578e-669b-412b-b595-5c59138fb0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149" returned: 0 in 0.892s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137196265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e62172-d1d3-4c18-b9d3-c2e8d182b051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:59Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Creating volume 95e62172-d1d3-4c18-b9d3-c2e8d182b051 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:14:59 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['12c3cbbf-733f-4bce-a84b-5c6e91447a32'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b94578e-669b-412b-b595-5c59138fb0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-982159860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee9e14e-30bc-4587-86a1-074fe1253ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:59Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cbb029-42a1-4bb2-92c9-06091e3598dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 1073741824 Apr 29 19:14:59 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cbb029-42a1-4bb2-92c9-06091e3598dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b992b5-30da-4e07-a305-e70ac7ea43df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b992b5-30da-4e07-a305-e70ac7ea43df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee9e14e-30bc-4587-86a1-074fe1253ec8', 'volume_name': 'volume-cee9e14e-30bc-4587-86a1-074fe1253ec8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5cee60-a9eb-4849-9127-ad60fc08f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5cee60-a9eb-4849-9127-ad60fc08f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95993a7-5645-4b2a-9540-7bf8468d14af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume cee9e14e-30bc-4587-86a1-074fe1253ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee9e14e-30bc-4587-86a1-074fe1253ec8', 'volume_size': 1} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc18a51d-b6ea-4cb2-b7dd-d82d27156741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17685ff-4095-47bf-a533-3e967951b149', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9d4ff0-c218-4f57-a9b9-b1a90fbc7a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Volume volume-d17685ff-4095-47bf-a533-3e967951b149 (d17685ff-4095-47bf-a533-3e967951b149): created successfully Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9d4ff0-c218-4f57-a9b9-b1a90fbc7a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Flow 'volume_create_manager' (df5b7e72-9585-4c28-b7e5-0aac635e6c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f9060343-a6f6-428b-9676-abfb69e3615b tempest-VolumesListTestJSON-58674277 None] Created volume successfully. Apr 29 19:14:59 devstack cinder-volume[84523]: WARNING cinder.db.sqlalchemy.api [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1631896956'] Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['75f404a8-de46-4378-bd01-8ecc585bab51', 'c915fb5f-5353-4b7c-9e02-5d2979cdcd3b', '253b83fc-7ddc-44eb-adb1-c3229c04044b', '4854e565-72ef-43d7-b19e-eabdb9ac3c33'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (c2168fab-a061-4e80-a3e6-740757233dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162de1b8-84e5-48df-8b2f-058b99debce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162de1b8-84e5-48df-8b2f-058b99debce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236452988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807b71cf-00fc-495c-8b14-44ad67d406ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:00Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b809305e-768e-4f67-b202-748acf80f02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b809305e-768e-4f67-b202-748acf80f02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c44b8f-f738-4d9e-af26-ab1e3732143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c44b8f-f738-4d9e-af26-ab1e3732143f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807b71cf-00fc-495c-8b14-44ad67d406ca', 'volume_name': 'volume-807b71cf-00fc-495c-8b14-44ad67d406ca', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddd0a1b-31c7-40cc-b2c1-75a21e656f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddd0a1b-31c7-40cc-b2c1-75a21e656f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5262e8b2-d6a6-47a3-8070-d7c84b831ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:14:59 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume 807b71cf-00fc-495c-8b14-44ad67d406ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807b71cf-00fc-495c-8b14-44ad67d406ca', 'volume_size': 1} Apr 29 19:14:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:00 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:00 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (7b778fb3-b079-40db-ad0a-685dacefdce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d0e04e-d59e-44a1-8cd0-d8e3cf3e1612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d0e04e-d59e-44a1-8cd0-d8e3cf3e1612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1846662412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdf42ee-be86-482d-8def-a3afa9da5e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:00Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81044245-0ee5-431c-b032-a032be6e4c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81044245-0ee5-431c-b032-a032be6e4c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24155652-e9a6-4fd1-b937-8782e5cc1020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24155652-e9a6-4fd1-b937-8782e5cc1020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cdf42ee-be86-482d-8def-a3afa9da5e3a', 'volume_name': 'volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b664127-4de1-48a7-aaff-190897f1ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b664127-4de1-48a7-aaff-190897f1ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f92f24-d387-4acc-aed0-6e7bae98cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:00 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume 1cdf42ee-be86-482d-8def-a3afa9da5e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a', 'volume_size': 1} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:00 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 1073741824" returned: 0 in 1.328s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:00 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 Apr 29 19:15:00 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (7ea2b64f-99a5-4cdf-8be7-f2f75e8d69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b212138-941e-41a2-8ee8-591461e1fe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b212138-941e-41a2-8ee8-591461e1fe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240541487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc1c22e-afce-428d-9b48-c4fa73c23422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:01Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff48ae07-908a-4b7d-9163-86207e264ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff48ae07-908a-4b7d-9163-86207e264ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766fe18e-504b-4f81-9f3b-764f111ae955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766fe18e-504b-4f81-9f3b-764f111ae955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc1c22e-afce-428d-9b48-c4fa73c23422', 'volume_name': 'volume-adc1c22e-afce-428d-9b48-c4fa73c23422', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccb1212-8d00-4780-a145-d674595669ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccb1212-8d00-4780-a145-d674595669ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0dc1b70-648d-4f39-9a2b-eec63a863e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume adc1c22e-afce-428d-9b48-c4fa73c23422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc1c22e-afce-428d-9b48-c4fa73c23422', 'volume_size': 1} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.253s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-42faa98b-e2a7-408d-a4d7-93491781bd65 tempest-GroupSnapshotsTest-1557513588 None] Delete group completed successfully. Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Flow 'volume_create_manager' (1f8cbbfb-e363-4e14-8c1c-79fd45bc7676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7cd8281-405e-4f0c-87fd-baa2103edbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7cd8281-405e-4f0c-87fd-baa2103edbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1228981147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56304aa04ce44520b1a1d77f58838098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:01Z,use_quota=True,user_id='207143e578b649978a749b0d2ead308a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb2b555-9838-42a0-af54-ebfc7b47c9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb2b555-9838-42a0-af54-ebfc7b47c9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9354bc7-8c2c-4039-a92d-90a5f927509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9354bc7-8c2c-4039-a92d-90a5f927509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4', 'volume_name': 'volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deca8a70-b2fc-4c6e-9212-f719442adc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deca8a70-b2fc-4c6e-9212-f719442adc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a12c63b-f1f7-43f9-9cf0-81694c868552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Volume dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4', 'volume_size': 1} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:01 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051" returned: 0 in 0.803s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.097s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-982159860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee9e14e-30bc-4587-86a1-074fe1253ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:14:59Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Creating volume cee9e14e-30bc-4587-86a1-074fe1253ec8 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:01 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 1073741824 Apr 29 19:15:01 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca8a057-08db-4c4b-9f36-298d69dcf897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db593a3-bad7-4fbe-a16c-b60be0a6238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2637f7ed-db20-43a7-a803-2bb1dd5ea9bd tempest-GroupSnapshotsTest-1557513588 None] Group tempest-GroupSnapshotsTest-Group-975308446: creating Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 (95e62172-d1d3-4c18-b9d3-c2e8d182b051): created successfully Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db593a3-bad7-4fbe-a16c-b60be0a6238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (3e5f04e8-1966-4a5b-8ecb-02abc568a551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d16d6dd8-b36f-4c1e-b32a-0cd6632d4437 tempest-CreateVolumesFromSnapshotTest-360175836 None] Created volume successfully. Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2637f7ed-db20-43a7-a803-2bb1dd5ea9bd tempest-GroupSnapshotsTest-1557513588 None] Group tempest-GroupSnapshotsTest-Group-975308446: created successfully Apr 29 19:15:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2637f7ed-db20-43a7-a803-2bb1dd5ea9bd tempest-GroupSnapshotsTest-1557513588 None] Create group completed successfully. Apr 29 19:15:02 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 1073741824" returned: 0 in 0.960s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:02 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 Apr 29 19:15:02 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Flow 'volume_create_manager' (85d1f142-5543-4837-a906-cff041a61750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b09643-cf5a-4968-b362-e7298bdc8774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:03 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b09643-cf5a-4968-b362-e7298bdc8774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1171897582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3531d41d-fdab-4d9e-a763-fd3e9911f61e,host='devstack@QuobyteHD#QuobyteHD',id=042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff39fec110b457b8af8586bdb121f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:03Z,use_quota=True,user_id='3dba5efe209846a0bba2c53467db5dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f271ce0-19b4-496b-87e8-1258786c41d1),volume_type_id=1f271ce0-19b4-496b-87e8-1258786c41d1)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce23a97e-4278-424e-8564-4f070fa906da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce23a97e-4278-424e-8564-4f070fa906da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9e3fcc-509f-4c4f-9705-0d704b5afa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9e3fcc-509f-4c4f-9705-0d704b5afa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc', 'volume_name': 'volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc982680-6f19-47d1-8375-87f4d001ec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc982680-6f19-47d1-8375-87f4d001ec97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad2e7a9-f2dd-48d2-8339-0f5dc9a2fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:03 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Volume 042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc', 'volume_size': 1} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8" returned: 0 in 0.778s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.469s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236452988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807b71cf-00fc-495c-8b14-44ad67d406ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:00Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Creating volume 807b71cf-00fc-495c-8b14-44ad67d406ca {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:03 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95993a7-5645-4b2a-9540-7bf8468d14af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee9e14e-30bc-4587-86a1-074fe1253ec8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417301ba-ce1e-40cf-803e-f7c96cbf9de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:03 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca 1073741824 Apr 29 19:15:03 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:03 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 (cee9e14e-30bc-4587-86a1-074fe1253ec8): created successfully Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417301ba-ce1e-40cf-803e-f7c96cbf9de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (45d52c66-3d26-4638-8975-7bc4366f5284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:03 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-04283e3d-afcc-493d-a58c-5fc5f67060f8 tempest-CreateVolumesFromSnapshotTest-360175836 None] Created volume successfully. Apr 29 19:15:04 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca 1073741824" returned: 0 in 0.816s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:04 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca Apr 29 19:15:04 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:05 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca" returned: 0 in 0.728s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.402s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1846662412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdf42ee-be86-482d-8def-a3afa9da5e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:00Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Creating volume 1cdf42ee-be86-482d-8def-a3afa9da5e3a {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:05 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:05 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a 1073741824 Apr 29 19:15:05 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5262e8b2-d6a6-47a3-8070-d7c84b831ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807b71cf-00fc-495c-8b14-44ad67d406ca', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4873cd59-8d95-41a4-bce7-936907578ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:05 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume volume-807b71cf-00fc-495c-8b14-44ad67d406ca (807b71cf-00fc-495c-8b14-44ad67d406ca): created successfully Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4873cd59-8d95-41a4-bce7-936907578ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (c2168fab-a061-4e80-a3e6-740757233dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:05 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-560ec408-34be-475c-8f25-3766c238b696 tempest-CreateVolumesFromSnapshotTest-360175836 None] Created volume successfully. Apr 29 19:15:06 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a 1073741824" returned: 0 in 0.942s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:06 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a Apr 29 19:15:06 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:06 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a" returned: 0 in 0.661s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.421s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240541487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc1c22e-afce-428d-9b48-c4fa73c23422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ba448811a54507b5024f2efe6c93da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:01Z,use_quota=True,user_id='dcaea2b669c64a649a479d60666fcd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Creating volume adc1c22e-afce-428d-9b48-c4fa73c23422 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:06 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:06 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 1073741824 Apr 29 19:15:06 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f92f24-d387-4acc-aed0-6e7bae98cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41651533-4af0-4fd9-b080-9637b325aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:06 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a (1cdf42ee-be86-482d-8def-a3afa9da5e3a): created successfully Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41651533-4af0-4fd9-b080-9637b325aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (7b778fb3-b079-40db-ad0a-685dacefdce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:06 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-15104bda-dc05-4973-b24b-07f8d0ea793c tempest-CreateVolumesFromSnapshotTest-360175836 None] Created volume successfully. Apr 29 19:15:07 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 1073741824" returned: 0 in 0.963s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:07 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 Apr 29 19:15:07 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:08 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422" returned: 0 in 0.644s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.917s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1228981147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56304aa04ce44520b1a1d77f58838098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:01Z,use_quota=True,user_id='207143e578b649978a749b0d2ead308a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Creating volume dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:08 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0dc1b70-648d-4f39-9a2b-eec63a863e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc1c22e-afce-428d-9b48-c4fa73c23422', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4ea3bd-b2f9-420a-8741-fec6fbe34923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:08 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 1073741824 Apr 29 19:15:08 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:08 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Volume volume-adc1c22e-afce-428d-9b48-c4fa73c23422 (adc1c22e-afce-428d-9b48-c4fa73c23422): created successfully Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4ea3bd-b2f9-420a-8741-fec6fbe34923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Flow 'volume_create_manager' (7ea2b64f-99a5-4cdf-8be7-f2f75e8d69a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:08 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d2a19eec-9346-4c3c-a3f5-b194fe04a0ba tempest-CreateVolumesFromSnapshotTest-360175836 None] Created volume successfully. Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-adc1c22e-afce-428d-9b48-c4fa73c23422-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-adc1c22e-afce-428d-9b48-c4fa73c23422-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-quobyte-adc1c22e-afce-428d-9b48-c4fa73c23422" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-adc1c22e-afce-428d-9b48-c4fa73c23422" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6499a3-e665-4d74-919e-6291e01058c3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Flow 'volume_create_manager' (4dd875f5-5fbf-4204-a542-05597d28a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af7e5bd-88ad-4945-b253-a23658f07c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af7e5bd-88ad-4945-b253-a23658f07c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-472502186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3acfc3-0a8a-4767-934b-378f7d8c16f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a017d30a5554d91881fd8cec88b8605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:09Z,use_quota=True,user_id='6e4a70ebb30d4929a207c7bb9662b3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec803fd-efa2-46a6-afca-9a45a10a4a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec803fd-efa2-46a6-afca-9a45a10a4a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a12b29e-eed3-4211-97d4-3d244f9b03c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a12b29e-eed3-4211-97d4-3d244f9b03c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3acfc3-0a8a-4767-934b-378f7d8c16f9', 'volume_name': 'volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23021745-8b4f-4ca4-8ea9-e248fb47d3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23021745-8b4f-4ca4-8ea9-e248fb47d3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afea5640-e075-4f46-bed9-22cd9a3a70b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:09 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Volume cb3acfc3-0a8a-4767-934b-378f7d8c16f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9', 'volume_size': 1} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:09 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 Apr 29 19:15:09 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:09 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 1073741824" returned: 0 in 0.841s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:09 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 Apr 29 19:15:09 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:09 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422" returned: 0 in 0.755s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:09 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422 Apr 29 19:15:09 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:09 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4" returned: 0 in 0.604s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.417s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3531d41d-fdab-4d9e-a763-fd3e9911f61e,created_at=2026-04-29T17:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1171897582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3531d41d-fdab-4d9e-a763-fd3e9911f61e,host='devstack@QuobyteHD#QuobyteHD',id=042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff39fec110b457b8af8586bdb121f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:03Z,use_quota=True,user_id='3dba5efe209846a0bba2c53467db5dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f271ce0-19b4-496b-87e8-1258786c41d1),volume_type_id=1f271ce0-19b4-496b-87e8-1258786c41d1)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Creating volume 042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:09 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:09 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc 1073741824 Apr 29 19:15:09 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a12c63b-f1f7-43f9-9cf0-81694c868552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b83556-cc56-49e3-9240-13f0bb915769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:09 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Volume volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 (dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4): created successfully Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b83556-cc56-49e3-9240-13f0bb915769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Flow 'volume_create_manager' (1f8cbbfb-e363-4e14-8c1c-79fd45bc7676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:09 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-67fa4f93-a550-4eef-97ce-8880461d891f tempest-VolumesListTestJSON-58674277 None] Created volume successfully. Apr 29 19:15:10 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-adc1c22e-afce-428d-9b48-c4fa73c23422" returned: 0 in 0.640s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-adc1c22e-afce-428d-9b48-c4fa73c23422" released by "delete_volume" :: held 1.444s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Created reservations ['1581c5fd-351e-43d9-83a2-4b2b3a80e787', '99896a43-99d0-4821-8b3b-639872abf207', '6cc0e8db-dbdf-4697-8939-7054ed4cf665', '4099dad3-9ac2-41d9-9a0c-2eec6d34275a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:10 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:10 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:10 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc 1073741824" returned: 0 in 0.783s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:10 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc Apr 29 19:15:10 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:11 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.616s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:11 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Deleted volume successfully. Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7d4a9e8a-e41f-46fa-804c-d4a440e14095 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-adc1c22e-afce-428d-9b48-c4fa73c23422-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-1cdf42ee-be86-482d-8def-a3afa9da5e3a-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-1cdf42ee-be86-482d-8def-a3afa9da5e3a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-quobyte-1cdf42ee-be86-482d-8def-a3afa9da5e3a" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-1cdf42ee-be86-482d-8def-a3afa9da5e3a" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0010ac-dadc-4b0e-81d8-dd8d9dafea35]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:11 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a Apr 29 19:15:11 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:11 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" returned: 0 in 0.685s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.345s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-472502186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3acfc3-0a8a-4767-934b-378f7d8c16f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a017d30a5554d91881fd8cec88b8605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:09Z,use_quota=True,user_id='6e4a70ebb30d4929a207c7bb9662b3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Creating volume cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:11 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=129,cinder:INSERT=33,cinder:UPDATE=138,cinder:DELETE=12 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad2e7a9-f2dd-48d2-8339-0f5dc9a2fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c79e0c6-1f88-4fbd-8176-0357f314f223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:11 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 1073741824 Apr 29 19:15:11 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:11 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Volume volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc (042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc): created successfully Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c79e0c6-1f88-4fbd-8176-0357f314f223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:11 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Flow 'volume_create_manager' (85d1f142-5543-4837-a906-cff041a61750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:11 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6adb62e6-5c02-40a2-805e-70ec37d4abb8 tempest-GroupSnapshotsTest-1557513588 None] Created volume successfully. Apr 29 19:15:12 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a" returned: 0 in 0.805s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:12 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a Apr 29 19:15:12 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:12 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 1073741824" returned: 0 in 0.943s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:12 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:15:12 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:12 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-1cdf42ee-be86-482d-8def-a3afa9da5e3a" returned: 0 in 0.845s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:12 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-1cdf42ee-be86-482d-8def-a3afa9da5e3a" released by "delete_volume" :: held 1.722s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Created reservations ['6045d475-e1a8-4804-ab9d-97d425d6dec9', 'e2addf6e-0eca-4b38-aaaa-4c7b7fceb382', '5c25f54c-0b9b-4a11-9bb2-f770b6960b26', '275ff333-78ab-4e03-a8ad-cf4de98184ae'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Flow 'volume_create_manager' (1605c9a9-d8c3-4b9c-b39e-a020e7f908a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da6c295-5453-4810-95f0-b397bd3d0b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da6c295-5453-4810-95f0-b397bd3d0b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381245336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3531d41d-fdab-4d9e-a763-fd3e9911f61e,host='devstack@QuobyteHD#QuobyteHD',id=e1a33bc1-36ca-48c1-8176-e32acb315d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff39fec110b457b8af8586bdb121f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:13Z,use_quota=True,user_id='3dba5efe209846a0bba2c53467db5dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f271ce0-19b4-496b-87e8-1258786c41d1),volume_type_id=1f271ce0-19b4-496b-87e8-1258786c41d1)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc38a7ed-87e9-47e0-aae0-9da8826fb39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc38a7ed-87e9-47e0-aae0-9da8826fb39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e19cca-6de1-4c94-83ca-6513d8eda61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e19cca-6de1-4c94-83ca-6513d8eda61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a33bc1-36ca-48c1-8176-e32acb315d95', 'volume_name': 'volume-e1a33bc1-36ca-48c1-8176-e32acb315d95', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d608f1-efd6-48a5-a304-b1994a884365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d608f1-efd6-48a5-a304-b1994a884365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed895366-db33-47dc-9099-0277bbb1f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:13 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Volume e1a33bc1-36ca-48c1-8176-e32acb315d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a33bc1-36ca-48c1-8176-e32acb315d95', 'volume_size': 1} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:13 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:13 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:13 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.922s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.181s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3531d41d-fdab-4d9e-a763-fd3e9911f61e,created_at=2026-04-29T17:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381245336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3531d41d-fdab-4d9e-a763-fd3e9911f61e,host='devstack@QuobyteHD#QuobyteHD',id=e1a33bc1-36ca-48c1-8176-e32acb315d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff39fec110b457b8af8586bdb121f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:13Z,use_quota=True,user_id='3dba5efe209846a0bba2c53467db5dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f271ce0-19b4-496b-87e8-1258786c41d1),volume_type_id=1f271ce0-19b4-496b-87e8-1258786c41d1)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Creating volume e1a33bc1-36ca-48c1-8176-e32acb315d95 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:13 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afea5640-e075-4f46-bed9-22cd9a3a70b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90155db1-1a1e-4334-9c3c-314d4dec6b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:13 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 1073741824 Apr 29 19:15:13 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-807b71cf-00fc-495c-8b14-44ad67d406ca-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:13 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Volume volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 (cb3acfc3-0a8a-4767-934b-378f7d8c16f9): created successfully Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90155db1-1a1e-4334-9c3c-314d4dec6b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Flow 'volume_create_manager' (4dd875f5-5fbf-4204-a542-05597d28a660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-807b71cf-00fc-495c-8b14-44ad67d406ca-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:13 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-fc755473-28fe-444a-94b3-4db267feb98b tempest-VolumesActionsTest-1471295530 None] Created volume successfully. Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-quobyte-807b71cf-00fc-495c-8b14-44ad67d406ca" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-807b71cf-00fc-495c-8b14-44ad67d406ca" acquired by "delete_volume" :: waited 0.033s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc7105-b6e0-4f71-ab31-a9f042bc4450]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:13 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca Apr 29 19:15:13 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Acquiring lock "cinder-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Lock "cinder-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:13 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.724s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:13 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:13 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Deleted volume successfully. Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-99ee66e7-f160-44e9-b081-56e6d8d1dcae tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-1cdf42ee-be86-482d-8def-a3afa9da5e3a-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Acquiring lock "cinder-quobyte-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Lock "cinder-quobyte-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4" acquired by "delete_volume" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[995db549-3f14-4c2e-9150-75ebd99fc43f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:14 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 Apr 29 19:15:14 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:14 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 1073741824" returned: 0 in 1.022s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:14 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 Apr 29 19:15:14 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:14 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca" returned: 0 in 0.906s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:14 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca Apr 29 19:15:14 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:14 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4" returned: 0 in 0.795s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:14 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4 Apr 29 19:15:14 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:15 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95" returned: 0 in 0.756s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:15 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-807b71cf-00fc-495c-8b14-44ad67d406ca" returned: 0 in 0.724s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed895366-db33-47dc-9099-0277bbb1f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a33bc1-36ca-48c1-8176-e32acb315d95', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac23121-237b-4e37-9d51-08dc0fd9c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-807b71cf-00fc-495c-8b14-44ad67d406ca" released by "delete_volume" :: held 1.703s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:15 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Volume volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 (e1a33bc1-36ca-48c1-8176-e32acb315d95): created successfully Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac23121-237b-4e37-9d51-08dc0fd9c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Flow 'volume_create_manager' (1605c9a9-d8c3-4b9c-b39e-a020e7f908a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:15 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-746daff7-d75a-4ee7-ad56-f6b1cccb28a4 tempest-GroupSnapshotsTest-1557513588 None] Created volume successfully. Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Created reservations ['cf7a4a41-c567-4232-8b0a-3923f8c289ee', 'd04aa589-0aba-4521-98e3-2665d89a9a2b', '79613bed-6415-4478-ba6a-ebb9c3dc1dc8', '5536308f-9d4d-48d5-a02c-48fd69738498'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:15 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:15 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:15 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4" returned: 0 in 0.733s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Lock "cinder-quobyte-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4" released by "delete_volume" :: held 1.572s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Created reservations ['4b98b956-4761-45b1-ac0a-f9eaebe912e2', '97f314b8-5a81-4789-ab89-36447aefd7ac', '966cdf21-47cf-4e3b-84e6-ff60dd4d52e9', '2a4aa163-0ae1-4d27-bbf3-27ecc694d9b0'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-cee9e14e-30bc-4587-86a1-074fe1253ec8-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-cee9e14e-30bc-4587-86a1-074fe1253ec8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-quobyte-cee9e14e-30bc-4587-86a1-074fe1253ec8" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:15 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:15 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-cee9e14e-30bc-4587-86a1-074fe1253ec8" acquired by "delete_volume" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dbd366-8ad4-46fc-8420-923eabc36a5e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:16 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 Apr 29 19:15:16 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:16 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.718s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:16 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Deleted volume successfully. Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-702d1e53-63d6-4f1b-9020-a736e91d7572 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-807b71cf-00fc-495c-8b14-44ad67d406ca-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Acquiring lock "cinder-d17685ff-4095-47bf-a533-3e967951b149-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Lock "cinder-d17685ff-4095-47bf-a533-3e967951b149-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Acquiring lock "cinder-quobyte-d17685ff-4095-47bf-a533-3e967951b149" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Lock "cinder-quobyte-d17685ff-4095-47bf-a533-3e967951b149" acquired by "delete_volume" :: waited 0.046s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5881d71a-8728-49dd-a197-af7f07b43efa]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:16 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-27a6acbd-41bc-4469-983d-fde286028902 tempest-GroupSnapshotsTest-1557513588 None] Update group completed successfully. Apr 29 19:15:16 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.870s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:16 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Deleted volume successfully. Apr 29 19:15:16 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 Apr 29 19:15:16 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-28a3bea2-96b8-46df-b416-321afa801490 tempest-VolumesListTestJSON-58674277 None] Lock "cinder-dfe596f8-cefd-4c28-b1d7-0f39fb4b5ca4-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:16 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8" returned: 0 in 0.955s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:16 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8 Apr 29 19:15:16 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:17 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149" returned: 0 in 0.841s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:17 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149 Apr 29 19:15:17 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:17 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cee9e14e-30bc-4587-86a1-074fe1253ec8" returned: 0 in 0.644s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-cee9e14e-30bc-4587-86a1-074fe1253ec8" released by "delete_volume" :: held 1.657s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Created reservations ['6de34d9d-716e-497a-b18a-4e58a2fc61f0', 'd1d23ab1-7cf8-417c-8a1c-cddc99112e57', 'b9b872e9-b2e5-41b8-962c-8060cbe706a5', 'fc94f930-4107-4b62-aee7-c6ed07cfde18'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:17 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:17 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0ca976c2-6008-466c-8c22-f63fa4b039b5 tempest-GroupSnapshotsTest-1557513588 None] Update group completed successfully. Apr 29 19:15:17 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-95e62172-d1d3-4c18-b9d3-c2e8d182b051-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-95e62172-d1d3-4c18-b9d3-c2e8d182b051-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:18 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d17685ff-4095-47bf-a533-3e967951b149" returned: 0 in 0.662s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-quobyte-95e62172-d1d3-4c18-b9d3-c2e8d182b051" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Lock "cinder-quobyte-d17685ff-4095-47bf-a533-3e967951b149" released by "delete_volume" :: held 1.578s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-95e62172-d1d3-4c18-b9d3-c2e8d182b051" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[95596b61-ba4a-45fa-a962-2c35e9d8fe54]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Created reservations ['93266fe9-956f-42a9-ba0a-9a6ca8db47b9', 'e6fd0c64-8682-47ec-b2de-b31340da0a2d', '5235af52-45fc-4201-b60d-f8000d4fa2ae', 'eb80027b-9b4a-4805-b326-340f05e159e1'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:18 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 Apr 29 19:15:18 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:18 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:18 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:18 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.710s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Deleted volume successfully. Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4214bbef-9243-4408-bd65-5c885a2136d4 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-cee9e14e-30bc-4587-86a1-074fe1253ec8-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Acquiring lock "cinder-f20bdd5c-9b3f-4808-b581-37b32c940a43-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Lock "cinder-f20bdd5c-9b3f-4808-b581-37b32c940a43-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Acquiring lock "cinder-quobyte-f20bdd5c-9b3f-4808-b581-37b32c940a43" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Lock "cinder-quobyte-f20bdd5c-9b3f-4808-b581-37b32c940a43" acquired by "delete_volume" :: waited 0.044s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5fe9eb-dd8a-4d55-88aa-a5b4e6e4aeca]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:18 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.721s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Deleted volume successfully. Apr 29 19:15:18 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051" returned: 0 in 0.864s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:19 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-31b84dca-60d3-4152-9a8b-6be75fadc124 tempest-GroupSnapshotsTest-1557513588 None] Update group completed successfully. Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-bde00df1-0aca-4666-a03a-5eef11b1b97b tempest-VolumesListTestJSON-58674277 None] Lock "cinder-d17685ff-4095-47bf-a533-3e967951b149-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:19 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051 Apr 29 19:15:19 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:19 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 Apr 29 19:15:19 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:19 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e62172-d1d3-4c18-b9d3-c2e8d182b051" returned: 0 in 0.622s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-95e62172-d1d3-4c18-b9d3-c2e8d182b051" released by "delete_volume" :: held 1.530s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:19 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43" returned: 0 in 0.755s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Created reservations ['2df36404-c911-4783-a6c2-48ae8e213575', 'f30aa212-ac14-4d58-a111-b2d965e89910', 'fe1578e6-76ce-4b82-b113-61d240d5d0e3', 'b89bc0d9-0fc0-4964-8c42-e8c1c3164f99'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:19 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43 Apr 29 19:15:19 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:19 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:19 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:20 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-65cd8cb2-65a7-4d47-bb79-39fcf3c71f6d tempest-GroupSnapshotsTest-1557513588 None] Update group completed successfully. Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-49716314-b35b-404e-a683-6a23e6da6c95-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-49716314-b35b-404e-a683-6a23e6da6c95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-quobyte-af3f5b87-1230-485a-9470-28c107958f09" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-af3f5b87-1230-485a-9470-28c107958f09" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-quobyte-49716314-b35b-404e-a683-6a23e6da6c95" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-49716314-b35b-404e-a683-6a23e6da6c95" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Deleting offline snapshot 49716314-b35b-404e-a683-6a23e6da6c95 of volume af3f5b87-1230-485a-9470-28c107958f09 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] snapshot_file for this snap is: volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed1a69-397d-4e88-bfc7-5c302b9c0459]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:20 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f20bdd5c-9b3f-4808-b581-37b32c940a43" returned: 0 in 0.758s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Lock "cinder-quobyte-f20bdd5c-9b3f-4808-b581-37b32c940a43" released by "delete_volume" :: held 1.606s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:20 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.733s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:20 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Deleted volume successfully. Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Created reservations ['90f95654-f56e-46ed-ab4f-9cfc2440e057', '494d90e0-d590-4571-be44-db5d66980884', 'b029c091-6969-4272-8ed8-fc7a9d19e5ed', '24231af0-c8a4-4ced-b35a-126322ec094f'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6c01776f-b1c3-4029-93a3-58d10f87207e tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-95e62172-d1d3-4c18-b9d3-c2e8d182b051-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:20 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 Apr 29 19:15:20 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:20 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:20 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:21 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95" returned: 0 in 0.974s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af3f5b87-1230-485a-9470-28c107958f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:15:21 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.842s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf2044-eaf1-4d3b-bdde-3d7d8bce8099]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:21 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Deleted volume successfully. Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-984220e9-2a80-41fe-8754-8c68067e735c tempest-VolumesListTestJSON-58674277 None] Lock "cinder-f20bdd5c-9b3f-4808-b581-37b32c940a43-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:21 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 Apr 29 19:15:21 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:21 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] GroupSnapshot 95b66047-a9ea-499a-9476-55d4b97e1b85: creating. Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Group snapshot 95b66047-a9ea-499a-9476-55d4b97e1b85: creating. {{(pid=84523) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Creating offline snapshot 71bef784-e734-4793-9a26-1befac95e083 of volume e1a33bc1-36ca-48c1-8176-e32acb315d95 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391686a-cbf6-47d1-ac29-0ffdbbcf71d8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:22 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 Apr 29 19:15:22 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:22 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09" returned: 0 in 1.133s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:22 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 Apr 29 19:15:22 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:23 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95" returned: 0 in 1.179s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:23 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 1G Apr 29 19:15:23 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:23 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95" returned: 0 in 1.043s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:23 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95 Apr 29 19:15:23 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:24 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 1G" returned: 0 in 1.012s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:24 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 Apr 29 19:15:24 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:24 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09.49716314-b35b-404e-a683-6a23e6da6c95" returned: 0 in 0.730s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-49716314-b35b-404e-a683-6a23e6da6c95" released by "_delete_snapshot" :: held 4.098s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-af3f5b87-1230-485a-9470-28c107958f09" released by "delete_snapshot" :: held 4.125s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Created reservations ['10045da7-dd2b-4dfb-a267-550f2c46fe12', '6a033e71-5e6e-49af-97ca-bfadfe105073', 'ff33da45-b140-4b93-be96-109c18151592', '3378233d-8b1a-4a7a-bacd-f7a200a2127c'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:24 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Delete snapshot completed successfully. Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-80897e9f-b5ec-43f9-9d5a-3a9fc1c5270b tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-49716314-b35b-404e-a683-6a23e6da6c95-delete_snapshot" released by "delete_snapshot" :: held 4.331s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:24 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083" returned: 0 in 0.703s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:24 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:15:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:24 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 Apr 29 19:15:24 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (b6d52b9a-284b-4e4a-abf8-8d8d752db5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e2b5c0-c20c-4bc1-9192-ad74a7bc2f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e2b5c0-c20c-4bc1-9192-ad74a7bc2f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48174462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:25Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec305e8-1644-44e6-ac4a-431a8cf2477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec305e8-1644-44e6-ac4a-431a8cf2477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61462d6b-9092-4502-bf91-2382da2ef51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61462d6b-9092-4502-bf91-2382da2ef51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3', 'volume_name': 'volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ced815-d061-4cae-b80a-88ec5dc172a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ced815-d061-4cae-b80a-88ec5dc172a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67956b25-acf9-4f87-bfff-2566678ff187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Volume 89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3', 'volume_size': 1} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:25 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083" returned: 0 in 0.665s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:25 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.info Apr 29 19:15:25 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (f85f5b7a-7dd3-438d-8718-c1189b97e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcf73a9-fe79-40fb-8eff-f305e8f2e2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcf73a9-fe79-40fb-8eff-f305e8f2e2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-966205642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e22ecb-0cf8-4e18-9dce-2efccba2be42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:25Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c018fd6c-34ca-4502-b7b5-45f55231445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c018fd6c-34ca-4502-b7b5-45f55231445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db92f97-ad3e-4f29-9002-4012235af8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db92f97-ad3e-4f29-9002-4012235af8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e22ecb-0cf8-4e18-9dce-2efccba2be42', 'volume_name': 'volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca21ff8-8c7c-49ea-be1b-4d7a4780aeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca21ff8-8c7c-49ea-be1b-4d7a4780aeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaedb944-9c67-491d-b37a-31fb44efb56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:25 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Volume 95e22ecb-0cf8-4e18-9dce-2efccba2be42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42', 'volume_size': 1} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-af3f5b87-1230-485a-9470-28c107958f09-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-af3f5b87-1230-485a-9470-28c107958f09-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "cinder-quobyte-af3f5b87-1230-485a-9470-28c107958f09" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-af3f5b87-1230-485a-9470-28c107958f09" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ccdf76-6ef4-4bda-87f6-c6852a0799ff]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:25 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (aebc167c-55fa-48b6-ad4b-d8e39e687866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef25039f-af35-4357-9e3f-1fb740296f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef25039f-af35-4357-9e3f-1fb740296f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1722185465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8410fcb7-240b-472b-8234-05de789b47f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:26Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0db69c-3ec9-441e-89fc-02ad580192d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0db69c-3ec9-441e-89fc-02ad580192d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ae0e0a-c7fa-461a-b781-a6b3c6737960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ae0e0a-c7fa-461a-b781-a6b3c6737960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8410fcb7-240b-472b-8234-05de789b47f4', 'volume_name': 'volume-8410fcb7-240b-472b-8234-05de789b47f4', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8a6034-9785-42e6-a1fd-8cc5e46fca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8a6034-9785-42e6-a1fd-8cc5e46fca3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5011bac2-b8f1-4b6c-9d57-a4c1fdbcf946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Volume 8410fcb7-240b-472b-8234-05de789b47f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8410fcb7-240b-472b-8234-05de789b47f4', 'volume_size': 1} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:26 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 Apr 29 19:15:26 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:26 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (490bb082-f278-49ca-995a-f3e57e545761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7ec0c0-b9c8-45b3-a5ab-ccc5729eb77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.info" returned: 0 in 1.003s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:26 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7ec0c0-b9c8-45b3-a5ab-ccc5729eb77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569283742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d70c4d-fd98-468e-96d8-a79d3e5d5070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:26Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a9141b-d04b-4832-8466-289df5d9f7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a9141b-d04b-4832-8466-289df5d9f7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49d0ac3-ea8a-4120-9d65-ffb773a32298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49d0ac3-ea8a-4120-9d65-ffb773a32298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d70c4d-fd98-468e-96d8-a79d3e5d5070', 'volume_name': 'volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.info Apr 29 19:15:26 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344179f8-3d8e-4d1c-bcd2-f00255b0780a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344179f8-3d8e-4d1c-bcd2-f00255b0780a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1aa49d-39ff-4d66-ad82-9f3d62b563b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Volume 90d70c4d-fd98-468e-96d8-a79d3e5d5070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070', 'volume_size': 1} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (12053edc-d999-42d0-990f-a67253b78f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7836ae5-5faa-4315-964d-5d497079f1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7836ae5-5faa-4315-964d-5d497079f1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1027392291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6dc578-c59d-4f67-ab47-f80115b9a4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:27Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d96520e-041d-4dc4-a0d9-cbd6ffb46f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d96520e-041d-4dc4-a0d9-cbd6ffb46f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc660ade-f0dd-455b-9daa-d0e167613dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc660ade-f0dd-455b-9daa-d0e167613dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6dc578-c59d-4f67-ab47-f80115b9a4bc', 'volume_name': 'volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49ff729-6b06-4c26-b7bb-504f68496108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49ff729-6b06-4c26-b7bb-504f68496108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a696bc09-fd44-4917-b920-78bd2c8c38f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:26 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Volume 8b6dc578-c59d-4f67-ab47-f80115b9a4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc', 'volume_size': 1} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:26 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09" returned: 0 in 1.082s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:27 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09 Apr 29 19:15:27 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:27 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.info" returned: 0 in 0.706s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.371s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Creating offline snapshot 91a42717-3854-4767-a6bd-5b4c2d06edf4 of volume 042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c3f0c2-00ed-463e-b692-51078e1b4cbb]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:27 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc Apr 29 19:15:27 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:27 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-af3f5b87-1230-485a-9470-28c107958f09" returned: 0 in 0.662s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-quobyte-af3f5b87-1230-485a-9470-28c107958f09" released by "delete_volume" :: held 1.848s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Created reservations ['71ce52ff-a5eb-4d99-89ae-c8d28e9618d1', '456222f1-e9d7-4c29-b7e7-d5c8a821c7e1', '51381c2c-7e50-41ef-a3e5-6c20e283f804', 'aa0369dd-9c9b-4f85-a28f-93dcfb55f774'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:27 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:27 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:28 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" returned: 0 in 0.808s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:28 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 1G Apr 29 19:15:28 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:28 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.618s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:28 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:28 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Deleted volume successfully. Apr 29 19:15:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5c723705-9b31-4513-98c2-2bd185d29881 tempest-CreateVolumesFromSnapshotTest-360175836 None] Lock "cinder-af3f5b87-1230-485a-9470-28c107958f09-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:29 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 1G" returned: 0 in 0.899s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:29 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 Apr 29 19:15:29 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:29 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:29 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:30 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4" returned: 0 in 1.189s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:30 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:15:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:30 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 Apr 29 19:15:30 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:30 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.023s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:15:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:15:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:15:31 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4" returned: 0 in 0.947s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:31 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.info Apr 29 19:15:31 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (5ebb6997-5fed-4e74-b82e-fa3e0fca1353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4762b01-9918-4dd4-be9b-23a80d2254a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4762b01-9918-4dd4-be9b-23a80d2254a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-790098255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d59c4a-c985-4624-8725-6ffedca8f947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:32Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc91364-3086-46e4-8f3f-262eb0707e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc91364-3086-46e4-8f3f-262eb0707e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddd25fb-2f7f-4927-9f07-715da10dc1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:31 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddd25fb-2f7f-4927-9f07-715da10dc1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d59c4a-c985-4624-8725-6ffedca8f947', 'volume_name': 'volume-52d59c4a-c985-4624-8725-6ffedca8f947', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d2078e-6b30-45f9-b2a7-0c82e04cae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d2078e-6b30-45f9-b2a7-0c82e04cae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21af64b7-0c1f-490a-97d6-1190978d8690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:32 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume 52d59c4a-c985-4624-8725-6ffedca8f947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d59c4a-c985-4624-8725-6ffedca8f947', 'volume_size': 1} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:32 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.info" returned: 0 in 0.906s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:32 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:32 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.info Apr 29 19:15:32 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:32 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.info" returned: 0 in 0.626s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.490s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.105s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-966205642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e22ecb-0cf8-4e18-9dce-2efccba2be42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:25Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Creating volume 95e22ecb-0cf8-4e18-9dce-2efccba2be42 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:32 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:32 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 1073741824 Apr 29 19:15:32 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:32 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ed7951af-7efa-4665-a1d1-ef3fdf439590 tempest-GroupSnapshotsTest-1557513588 None] group_snapshot 95b66047-a9ea-499a-9476-55d4b97e1b85: created successfully Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4ca80b7f-988c-4518-be47-1719abd8479d tempest-VolumesActionsTest-1471295530 None] Acquiring lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" by "attach_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4ca80b7f-988c-4518-be47-1719abd8479d tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" acquired by "attach_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4ca80b7f-988c-4518-be47-1719abd8479d tempest-VolumesActionsTest-1471295530 None] Attaching volume cb3acfc3-0a8a-4767-934b-378f7d8c16f9 to instance aabed388-df1b-494d-9e09-ddf3ba98347e at mountpoint /dev/vdb on host None. Apr 29 19:15:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4ca80b7f-988c-4518-be47-1719abd8479d tempest-VolumesActionsTest-1471295530 None] Attach volume completed successfully. Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4ca80b7f-988c-4518-be47-1719abd8479d tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" released by "attach_volume" :: held 0.130s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] group_snapshot 95b66047-a9ea-499a-9476-55d4b97e1b85: deleting Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] group_snapshot 95b66047-a9ea-499a-9476-55d4b97e1b85: deleting {{(pid=84523) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-e1a33bc1-36ca-48c1-8176-e32acb315d95" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-e1a33bc1-36ca-48c1-8176-e32acb315d95" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-71bef784-e734-4793-9a26-1befac95e083" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:33 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-71bef784-e734-4793-9a26-1befac95e083" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Deleting offline snapshot 71bef784-e734-4793-9a26-1befac95e083 of volume e1a33bc1-36ca-48c1-8176-e32acb315d95 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] snapshot_file for this snap is: volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 1073741824" returned: 0 in 1.038s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50cbe2e-115c-413f-8d4f-bd6a208365f5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:33 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 Apr 29 19:15:33 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:33 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 Apr 29 19:15:33 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-343dbec0-5b49-423b-bbab-0ac4d07f9a8b tempest-VolumesActionsTest-1471295530 None] Acquiring lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-detach_volume" by "detach_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-343dbec0-5b49-423b-bbab-0ac4d07f9a8b tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:34 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-343dbec0-5b49-423b-bbab-0ac4d07f9a8b tempest-VolumesActionsTest-1471295530 None] Detaching volume cb3acfc3-0a8a-4767-934b-378f7d8c16f9 from instance aabed388-df1b-494d-9e09-ddf3ba98347e. Apr 29 19:15:34 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-343dbec0-5b49-423b-bbab-0ac4d07f9a8b tempest-VolumesActionsTest-1471295530 None] Detach volume completed successfully. Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-343dbec0-5b49-423b-bbab-0ac4d07f9a8b tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:34 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42" returned: 0 in 0.728s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.517s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1722185465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8410fcb7-240b-472b-8234-05de789b47f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:26Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Creating volume 8410fcb7-240b-472b-8234-05de789b47f4 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:34 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaedb944-9c67-491d-b37a-31fb44efb56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:34 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 1073741824 Apr 29 19:15:34 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fef62b-0cf8-4479-98b8-039e7e34b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:34 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Volume volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 (95e22ecb-0cf8-4e18-9dce-2efccba2be42): created successfully Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fef62b-0cf8-4479-98b8-039e7e34b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:34 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (f85f5b7a-7dd3-438d-8718-c1189b97e63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083" returned: 0 in 0.877s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1a33bc1-36ca-48c1-8176-e32acb315d95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb76044c-dae1-4764-bfac-226e36fbca70]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:34 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ec7b33dd-cdce-4371-b04a-493394b4cccf tempest-CreateVolumesFromImageTest-1916671186 None] Created volume successfully. Apr 29 19:15:34 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 Apr 29 19:15:34 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:35 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95" returned: 0 in 0.827s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:35 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 1073741824" returned: 0 in 0.977s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:35 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 Apr 29 19:15:35 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:35 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 Apr 29 19:15:35 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:36 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4" returned: 0 in 0.822s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.873s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569283742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d70c4d-fd98-468e-96d8-a79d3e5d5070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:26Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Creating volume 90d70c4d-fd98-468e-96d8-a79d3e5d5070 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:36 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5011bac2-b8f1-4b6c-9d57-a4c1fdbcf946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8410fcb7-240b-472b-8234-05de789b47f4', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de650d0-8042-42c2-aa1d-6a3abe079238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:36 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 1073741824 Apr 29 19:15:36 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:36 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:36 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Volume volume-8410fcb7-240b-472b-8234-05de789b47f4 (8410fcb7-240b-472b-8234-05de789b47f4): created successfully Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de650d0-8042-42c2-aa1d-6a3abe079238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (aebc167c-55fa-48b6-ad4b-d8e39e687866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083" returned: 0 in 1.002s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6bf28d66-fe56-487a-b174-93e6f97eccd5 tempest-CreateVolumesFromImageTest-1916671186 None] Created volume successfully. Apr 29 19:15:36 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083 Apr 29 19:15:36 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:37 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95.71bef784-e734-4793-9a26-1befac95e083" returned: 0 in 0.679s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-71bef784-e734-4793-9a26-1befac95e083" released by "_delete_snapshot" :: held 3.512s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-e1a33bc1-36ca-48c1-8176-e32acb315d95" released by "delete_snapshot" :: held 3.542s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-91a42717-3854-4767-a6bd-5b4c2d06edf4" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-91a42717-3854-4767-a6bd-5b4c2d06edf4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Deleting offline snapshot 91a42717-3854-4767-a6bd-5b4c2d06edf4 of volume 042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:15:37 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] snapshot_file for this snap is: volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 1073741824" returned: 0 in 0.885s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd85a7f3-4f29-42b5-8897-c2f846737695]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:37 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 Apr 29 19:15:37 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:37 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 Apr 29 19:15:37 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:38 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070" returned: 0 in 0.687s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.282s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1027392291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6dc578-c59d-4f67-ab47-f80115b9a4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:27Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Creating volume 8b6dc578-c59d-4f67-ab47-f80115b9a4bc {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:38 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1aa49d-39ff-4d66-ad82-9f3d62b563b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:38 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc 1073741824 Apr 29 19:15:38 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10502cd-82f2-42da-9cd7-d84919bb4b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:38 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Volume volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 (90d70c4d-fd98-468e-96d8-a79d3e5d5070): created successfully Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10502cd-82f2-42da-9cd7-d84919bb4b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (490bb082-f278-49ca-995a-f3e57e545761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-41dc5c7d-a746-4818-90e4-be01218f0b64 tempest-CreateVolumesFromImageTest-1916671186 None] Created volume successfully. Apr 29 19:15:38 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4" returned: 0 in 0.827s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb0a19-aad9-41c7-ba9f-07e622ef0db4]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:38 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc Apr 29 19:15:38 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:38 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc 1073741824" returned: 0 in 0.855s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:INSERT=55,cinder:UPDATE=191,cinder:SELECT=158,cinder:DELETE=10 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:39 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" returned: 0 in 0.767s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:39 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc Apr 29 19:15:39 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:39 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 Apr 29 19:15:39 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:39 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc" returned: 0 in 0.634s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.364s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48174462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d4d40835ec4075926d1f810f3bb352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:25Z,use_quota=True,user_id='673787fb1ddc4b4eb9b346512345f7dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Creating volume 89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:39 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:39 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 1073741824 Apr 29 19:15:39 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a696bc09-fd44-4917-b920-78bd2c8c38f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d080c2e0-b460-4fd8-8f54-cb1f660a4c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:39 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:39 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Volume volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc (8b6dc578-c59d-4f67-ab47-f80115b9a4bc): created successfully Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d080c2e0-b460-4fd8-8f54-cb1f660a4c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (12053edc-d999-42d0-990f-a67253b78f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4" returned: 0 in 0.708s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:39 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1404725a-aec5-41ea-8432-f7a52763528b tempest-CreateVolumesFromImageTest-1916671186 None] Created volume successfully. Apr 29 19:15:39 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4 Apr 29 19:15:39 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:40 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc.91a42717-3854-4767-a6bd-5b4c2d06edf4" returned: 0 in 0.601s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-91a42717-3854-4767-a6bd-5b4c2d06edf4" released by "_delete_snapshot" :: held 3.031s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" released by "delete_snapshot" :: held 3.054s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:40 devstack cinder-volume[84523]: WARNING cinder.quota [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-974517819 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-974517819, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:15:40 devstack cinder-volume[84523]: WARNING cinder.quota [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-974517819 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-974517819, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:15:40 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['f681dd28-3dd1-4c4e-8f51-7be27982d467', 'b8667dc4-63c6-4824-a682-993ac8dd05db', '50149d15-9ee2-47fa-80ff-435d0e4f79f1', '79ccb9be-b319-427d-851d-c3ce2404e62b'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:40 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 1073741824" returned: 0 in 0.835s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:40 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 Apr 29 19:15:40 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:40 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['6039be20-3c9c-485e-92a4-dac956308b08', '3b85979b-2695-43c8-a364-87f8b181114b', 'eb4d77f9-4623-405a-b014-88a53542f406', '89933c0d-2142-43ac-b470-ee220ade97bb'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-66c4c3bc-a153-4319-a83b-fa23bae3664b tempest-GroupSnapshotsTest-1557513588 None] group_snapshot 95b66047-a9ea-499a-9476-55d4b97e1b85: deleted successfully Apr 29 19:15:41 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3" returned: 0 in 0.623s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.166s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-790098255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d59c4a-c985-4624-8725-6ffedca8f947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:32Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Creating volume 52d59c4a-c985-4624-8725-6ffedca8f947 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:41 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67956b25-acf9-4f87-bfff-2566678ff187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85a77f6-2247-4813-bebe-78af0d28aa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:41 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 1073741824 Apr 29 19:15:41 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:41 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Volume volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 (89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3): created successfully Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85a77f6-2247-4813-bebe-78af0d28aa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Flow 'volume_create_manager' (b6d52b9a-284b-4e4a-abf8-8d8d752db5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:41 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-12019757-7911-450c-abfb-95752f73ee59 tempest-CreateVolumesFromImageTest-1916671186 None] Created volume successfully. Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" acquired by "delete_volume" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e7dea1-b446-4a32-953d-648e43815474]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:41 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc Apr 29 19:15:41 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:42 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-8b6dc578-c59d-4f67-ab47-f80115b9a4bc-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 1073741824" returned: 0 in 1.065s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-8b6dc578-c59d-4f67-ab47-f80115b9a4bc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:42 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 Apr 29 19:15:42 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-quobyte-8b6dc578-c59d-4f67-ab47-f80115b9a4bc" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-8b6dc578-c59d-4f67-ab47-f80115b9a4bc" acquired by "delete_volume" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58cfb8a-2794-42b9-8d68-f39441cde647]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:42 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc Apr 29 19:15:42 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:42 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" returned: 0 in 0.996s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:42 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc Apr 29 19:15:42 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:43 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947" returned: 0 in 0.713s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21af64b7-0c1f-490a-97d6-1190978d8690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d59c4a-c985-4624-8725-6ffedca8f947', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f153246f-18ef-410f-bdc2-84a7230947a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:43 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume volume-52d59c4a-c985-4624-8725-6ffedca8f947 (52d59c4a-c985-4624-8725-6ffedca8f947): created successfully Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f153246f-18ef-410f-bdc2-84a7230947a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (5ebb6997-5fed-4e74-b82e-fa3e0fca1353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:43 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5f825052-638b-4ab5-8f60-50c39e6e39c7 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created volume successfully. Apr 29 19:15:43 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc" returned: 0 in 0.897s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:43 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc Apr 29 19:15:43 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:43 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" returned: 0 in 0.711s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-042eaf0a-fbfa-4b63-865b-5de6f0c1cdcc" released by "delete_volume" :: held 1.796s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-e1a33bc1-36ca-48c1-8176-e32acb315d95" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-e1a33bc1-36ca-48c1-8176-e32acb315d95" acquired by "delete_volume" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c392f7-ec15-4592-85c4-a73df82efdfe]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:43 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 Apr 29 19:15:43 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:44 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8b6dc578-c59d-4f67-ab47-f80115b9a4bc" returned: 0 in 0.672s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-8b6dc578-c59d-4f67-ab47-f80115b9a4bc" released by "delete_volume" :: held 1.630s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Created reservations ['5ae57e09-84cf-4497-857f-2dcc87848d11', 'cd592b7d-65be-4ec9-873f-307c1d10f8c6', '9716178e-c705-4231-8b73-349a1b90c319', '06b44f81-4ed2-4cf9-8622-fb626519efa4'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (e3f391b7-75a4-4602-9014-fcdbba2fe57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901eb604-de7e-4d3b-810c-df1cb1e7d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901eb604-de7e-4d3b-810c-df1cb1e7d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570150723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e59709b-9b46-4025-8d44-bf2b7bbe06b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:44Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad85606-54dd-476d-a247-2968e1d87525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:44 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad85606-54dd-476d-a247-2968e1d87525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be138d1-0459-46fb-8bf5-1c204211787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be138d1-0459-46fb-8bf5-1c204211787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e59709b-9b46-4025-8d44-bf2b7bbe06b3', 'volume_name': 'volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df621477-1a61-44b0-b1d4-ed282faa9ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df621477-1a61-44b0-b1d4-ed282faa9ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041ec21d-5625-4bef-a033-dc7ae612b270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:44 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume 4e59709b-9b46-4025-8d44-bf2b7bbe06b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3', 'volume_size': 1} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570150723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e59709b-9b46-4025-8d44-bf2b7bbe06b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:44Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Creating volume 4e59709b-9b46-4025-8d44-bf2b7bbe06b3 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:44 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95" returned: 0 in 0.846s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:44 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 1073741824 Apr 29 19:15:44 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:44 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95 Apr 29 19:15:44 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:44 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:44 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-90d70c4d-fd98-468e-96d8-a79d3e5d5070-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-90d70c4d-fd98-468e-96d8-a79d3e5d5070-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-quobyte-90d70c4d-fd98-468e-96d8-a79d3e5d5070" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-90d70c4d-fd98-468e-96d8-a79d3e5d5070" acquired by "delete_volume" :: waited 0.037s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (24335b00-fffd-4668-b0b5-a97acdea8939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d79d76-b996-4ff5-a5f1-612238e0638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c0c88-d368-4a65-9239-4587a46f1f05]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d79d76-b996-4ff5-a5f1-612238e0638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997594524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2c49d5-b4c6-498e-9512-6c988afac56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:45Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0005b4-9719-4d88-bc77-8ddcb80ec294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0005b4-9719-4d88-bc77-8ddcb80ec294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6f1700-2c39-40ad-9367-38b4fed83f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6f1700-2c39-40ad-9367-38b4fed83f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2c49d5-b4c6-498e-9512-6c988afac56b', 'volume_name': 'volume-6e2c49d5-b4c6-498e-9512-6c988afac56b', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a11e80-556c-476e-8f44-f9aff1688d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a11e80-556c-476e-8f44-f9aff1688d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886231e9-33b3-42c0-a55c-521f5a13f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume 6e2c49d5-b4c6-498e-9512-6c988afac56b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2c49d5-b4c6-498e-9512-6c988afac56b', 'volume_size': 1} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:45 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 Apr 29 19:15:45 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:45 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e1a33bc1-36ca-48c1-8176-e32acb315d95" returned: 0 in 1.082s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-e1a33bc1-36ca-48c1-8176-e32acb315d95" released by "delete_volume" :: held 1.999s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:45 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 1073741824" returned: 0 in 1.172s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (5762526f-7e32-47ef-9963-19cd55c2abbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa84941-5de1-4810-8b7f-ff333e9af843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa84941-5de1-4810-8b7f-ff333e9af843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453680329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1803df-9c79-4617-a0d4-b1965a4f3973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:45Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d417e5f1-3440-4677-a777-f63c56743c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d417e5f1-3440-4677-a777-f63c56743c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23225d72-0496-4b54-b1b2-ed8d93b858d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23225d72-0496-4b54-b1b2-ed8d93b858d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1803df-9c79-4617-a0d4-b1965a4f3973', 'volume_name': 'volume-ac1803df-9c79-4617-a0d4-b1965a4f3973', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:45 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ad86a9-7106-4b11-8b36-fbb263e3d71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ad86a9-7106-4b11-8b36-fbb263e3d71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd90237-19e8-495b-a677-a6e5319ca240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume ac1803df-9c79-4617-a0d4-b1965a4f3973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1803df-9c79-4617-a0d4-b1965a4f3973', 'volume_size': 1} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.204s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Deleted volume successfully. Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d01388a2-cb5c-4cec-8bd6-e1fb85f34b5c tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-8b6dc578-c59d-4f67-ab47-f80115b9a4bc-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:45 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 Apr 29 19:15:45 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['83ff51c4-3717-4a06-8b76-38339ef834ed'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:45 devstack cinder-volume[84523]: WARNING cinder.quota [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-974517819 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-974517819, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['b381c896-bb29-43e8-95b2-60ed1d784cfa', '424c5efa-3902-4cbb-87dc-dc5dc471f686', '396d43e5-caa3-479e-ac3d-b61073f9627b', '4da7d56a-3882-41db-a3aa-d9ae302982e5'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:45 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (69c3df25-5523-483c-a648-a93cdd9c7875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88947fc-1e67-4bb3-b28a-0bf043cb86ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88947fc-1e67-4bb3-b28a-0bf043cb86ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1064295904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bfe1a8-a1db-44dd-864c-9f5e03757248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:46Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24cdb56-4c7f-43da-822a-73c9877162bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24cdb56-4c7f-43da-822a-73c9877162bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea89e4ea-f15e-4e76-89a5-8c037d1c1e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea89e4ea-f15e-4e76-89a5-8c037d1c1e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bfe1a8-a1db-44dd-864c-9f5e03757248', 'volume_name': 'volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883cb266-0543-4ea6-b66e-b52955d618bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883cb266-0543-4ea6-b66e-b52955d618bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251f5d83-fe72-4635-b26a-3554133d87ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume c0bfe1a8-a1db-44dd-864c-9f5e03757248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248', 'volume_size': 1} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070" returned: 0 in 1.147s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:46 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070 Apr 29 19:15:46 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['93e0b38a-6d39-4b57-8b9d-7290d3d9ed7d', '6e2c75ef-c195-4d0e-8260-e597c9b8e115', 'a32a3b84-c121-44fb-9a40-580f4150c832', 'a9cee462-ba25-4147-8bc1-8954b8026511'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:46 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:46 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (ae74607e-e87f-4eeb-9827-a7ea0b2383c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0b2068-07de-43ae-bc22-f058f5b93f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0b2068-07de-43ae-bc22-f058f5b93f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062048909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7bb135-1798-4945-a0af-6488a108a8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:46Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef21e59-6c01-4371-a918-fbf87265d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef21e59-6c01-4371-a918-fbf87265d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a08c9f3-00cd-47cf-8c44-eadc91889004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a08c9f3-00cd-47cf-8c44-eadc91889004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7bb135-1798-4945-a0af-6488a108a8ae', 'volume_name': 'volume-5d7bb135-1798-4945-a0af-6488a108a8ae', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d78b533-6f9d-4efb-9212-7952609d53f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d78b533-6f9d-4efb-9212-7952609d53f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8af3fc1-b35c-439e-b855-1d596bc48611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume 5d7bb135-1798-4945-a0af-6488a108a8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7bb135-1798-4945-a0af-6488a108a8ae', 'volume_size': 1} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:46 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3" returned: 0 in 0.968s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997594524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2c49d5-b4c6-498e-9512-6c988afac56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:45Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Creating volume 6e2c49d5-b4c6-498e-9512-6c988afac56b {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:46 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041ec21d-5625-4bef-a033-dc7ae612b270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b 1073741824 Apr 29 19:15:46 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a68d45e-cb73-42cb-b2b5-148ff2b16c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:46 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 (4e59709b-9b46-4025-8d44-bf2b7bbe06b3): created successfully Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a68d45e-cb73-42cb-b2b5-148ff2b16c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (e3f391b7-75a4-4602-9014-fcdbba2fe57a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:46 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a0346f9f-e90c-4d70-b807-63462a126094 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created volume successfully. Apr 29 19:15:46 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-90d70c4d-fd98-468e-96d8-a79d3e5d5070" returned: 0 in 0.708s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-90d70c4d-fd98-468e-96d8-a79d3e5d5070" released by "delete_volume" :: held 1.971s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:46 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Created reservations ['6d246afe-c66f-40e4-a1f3-c2703c7b8cb8', '2c2a3a09-0b86-4fcb-8493-456a21e962e1', '70af38ce-b11f-49bb-9027-503104b6fca6', 'c86d4419-522f-4bbf-94a6-7d913309893f'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:47 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:47 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:47 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.695s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:47 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-eba31dc9-8ae4-4b49-b7bd-479a608b159d tempest-GroupSnapshotsTest-1557513588 None] Delete group completed successfully. Apr 29 19:15:47 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b 1073741824" returned: 0 in 1.126s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:47 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b Apr 29 19:15:47 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:47 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.946s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:47 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:47 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Deleted volume successfully. Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dcc507e0-4195-40ff-bcec-514103f3a693 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-90d70c4d-fd98-468e-96d8-a79d3e5d5070-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-8410fcb7-240b-472b-8234-05de789b47f4-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-8410fcb7-240b-472b-8234-05de789b47f4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-quobyte-8410fcb7-240b-472b-8234-05de789b47f4" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:48 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7948c00d-b1c3-4f45-9522-92042a114ffe tempest-GroupSnapshotsTest-1557513588 None] Group tempest-GroupSnapshotsTest-Group-2096330799: creating Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-8410fcb7-240b-472b-8234-05de789b47f4" acquired by "delete_volume" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ccccf-9677-4fa9-aba6-d8d777211445]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:48 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7948c00d-b1c3-4f45-9522-92042a114ffe tempest-GroupSnapshotsTest-1557513588 None] Group tempest-GroupSnapshotsTest-Group-2096330799: created successfully Apr 29 19:15:48 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7948c00d-b1c3-4f45-9522-92042a114ffe tempest-GroupSnapshotsTest-1557513588 None] Create group completed successfully. Apr 29 19:15:48 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 Apr 29 19:15:48 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:48 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b" returned: 0 in 1.048s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.269s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453680329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1803df-9c79-4617-a0d4-b1965a4f3973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:45Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Creating volume ac1803df-9c79-4617-a0d4-b1965a4f3973 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:48 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886231e9-33b3-42c0-a55c-521f5a13f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2c49d5-b4c6-498e-9512-6c988afac56b', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:48 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 1073741824 Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f64e022-8c18-4d5b-ab2c-4fe21768d2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:48 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:48 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume volume-6e2c49d5-b4c6-498e-9512-6c988afac56b (6e2c49d5-b4c6-498e-9512-6c988afac56b): created successfully Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f64e022-8c18-4d5b-ab2c-4fe21768d2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:48 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (24335b00-fffd-4668-b0b5-a97acdea8939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:48 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0d39d712-9623-45f7-ac68-5fd3f86fc23e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created volume successfully. Apr 29 19:15:49 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4" returned: 0 in 0.858s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:49 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4 Apr 29 19:15:49 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:50 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Flow 'volume_create_manager' (23ff447e-1229-4a16-bc6a-f73d1443db4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae718875-dd08-4e52-a37d-4043936a9643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 1073741824" returned: 0 in 1.268s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:50 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae718875-dd08-4e52-a37d-4043936a9643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1645766076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ade3252f-54dd-444d-9da2-9edc7e0c570a,host='devstack@QuobyteHD#QuobyteHD',id=3e8f1181-1467-41c7-8d61-82c3546d6207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff39fec110b457b8af8586bdb121f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:50Z,use_quota=True,user_id='3dba5efe209846a0bba2c53467db5dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd4f2ada-c52b-43ef-9dd9-0999e9d3522d),volume_type_id=dd4f2ada-c52b-43ef-9dd9-0999e9d3522d)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdec886-3eb5-4847-93f8-579ac7e2faa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdec886-3eb5-4847-93f8-579ac7e2faa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c446f27-d674-41a4-93d3-8ff34ddcc3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c446f27-d674-41a4-93d3-8ff34ddcc3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8f1181-1467-41c7-8d61-82c3546d6207', 'volume_name': 'volume-3e8f1181-1467-41c7-8d61-82c3546d6207', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3a11c3-cc1f-4b98-bcea-af5ba9b4f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3a11c3-cc1f-4b98-bcea-af5ba9b4f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba01b04b-51e7-46d5-84c2-45099def8b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:50 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Volume 3e8f1181-1467-41c7-8d61-82c3546d6207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8f1181-1467-41c7-8d61-82c3546d6207', 'volume_size': 1} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-8410fcb7-240b-472b-8234-05de789b47f4" returned: 0 in 0.943s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-8410fcb7-240b-472b-8234-05de789b47f4" released by "delete_volume" :: held 1.854s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:50 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 Apr 29 19:15:50 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Created reservations ['ae4dbc43-6778-4ca2-8922-0e3cf5241856', 'b98eaca4-96d3-4e0f-a214-8ab430eadc8b', '8b69732f-7207-47c7-a74e-b691343c49a2', '4cf4a6fc-5531-414f-9474-fcda31444c39'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:50 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:50 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-95e22ecb-0cf8-4e18-9dce-2efccba2be42-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-95e22ecb-0cf8-4e18-9dce-2efccba2be42-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-quobyte-95e22ecb-0cf8-4e18-9dce-2efccba2be42" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-95e22ecb-0cf8-4e18-9dce-2efccba2be42" acquired by "delete_volume" :: waited 0.049s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2622cd6-7409-4310-9405-76a25d6447ac]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:50 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 Apr 29 19:15:50 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:50 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973" returned: 0 in 0.701s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.869s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1064295904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bfe1a8-a1db-44dd-864c-9f5e03757248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:46Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Creating volume c0bfe1a8-a1db-44dd-864c-9f5e03757248 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:50 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:51 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.641s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:51 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Deleted volume successfully. Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd90237-19e8-495b-a677-a6e5319ca240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1803df-9c79-4617-a0d4-b1965a4f3973', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:51 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 1073741824 Apr 29 19:15:51 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887bb430-907f-4903-9dcc-2c7c2ddecaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e8864129-ffd0-49a4-a19a-641215ef4c64 tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-8410fcb7-240b-472b-8234-05de789b47f4-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 (ac1803df-9c79-4617-a0d4-b1965a4f3973): created successfully Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887bb430-907f-4903-9dcc-2c7c2ddecaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (5762526f-7e32-47ef-9963-19cd55c2abbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:51 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-aab98671-09e6-4887-996d-a3c930bfdd95 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created volume successfully. Apr 29 19:15:51 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42" returned: 0 in 0.785s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:51 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42 Apr 29 19:15:51 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:51 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 1073741824" returned: 0 in 0.873s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:51 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 Apr 29 19:15:51 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:52 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-95e22ecb-0cf8-4e18-9dce-2efccba2be42" returned: 0 in 0.604s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-95e22ecb-0cf8-4e18-9dce-2efccba2be42" released by "delete_volume" :: held 1.441s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Created reservations ['ce8802fe-976c-45ba-ad52-4c84c0c17926', '659bf307-d798-4050-af54-0a2b0de9f06e', '4af82301-ca26-4563-9652-7a8a73156262', 'b1550307-4280-4a00-ac12-84eb86727b39'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:52 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:52 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:52 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248" returned: 0 in 0.672s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.979s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062048909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7bb135-1798-4945-a0af-6488a108a8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cc0b33ae3b4a6eab01c6c256afc9a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:46Z,use_quota=True,user_id='f1a279060afd4e1e9f81547cf078615d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Creating volume 5d7bb135-1798-4945-a0af-6488a108a8ae {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:52 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:52 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae 1073741824 Apr 29 19:15:52 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251f5d83-fe72-4635-b26a-3554133d87ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2a33fc-b4ec-4698-b2cf-b3987d1bc34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:52 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 (c0bfe1a8-a1db-44dd-864c-9f5e03757248): created successfully Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2a33fc-b4ec-4698-b2cf-b3987d1bc34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (69c3df25-5523-483c-a648-a93cdd9c7875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:52 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d1250818-34c6-4c09-99fe-fd6b18e76b32 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created volume successfully. Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "cinder-quobyte-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:52 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.678s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:52 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Deleted volume successfully. Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eb3f03-4be3-4e20-b28d-15171f3a9c3c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e0233cb1-3414-4b84-aa44-cb00853a009e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-95e22ecb-0cf8-4e18-9dce-2efccba2be42-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:53 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 Apr 29 19:15:53 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:53 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae 1073741824" returned: 0 in 0.974s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:53 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae Apr 29 19:15:53 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:53 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3" returned: 0 in 0.866s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:53 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3 Apr 29 19:15:53 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:54 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae" returned: 0 in 0.598s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.995s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ade3252f-54dd-444d-9da2-9edc7e0c570a,created_at=2026-04-29T17:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1645766076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ade3252f-54dd-444d-9da2-9edc7e0c570a,host='devstack@QuobyteHD#QuobyteHD',id=3e8f1181-1467-41c7-8d61-82c3546d6207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff39fec110b457b8af8586bdb121f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:15:50Z,use_quota=True,user_id='3dba5efe209846a0bba2c53467db5dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd4f2ada-c52b-43ef-9dd9-0999e9d3522d),volume_type_id=dd4f2ada-c52b-43ef-9dd9-0999e9d3522d)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Creating volume 3e8f1181-1467-41c7-8d61-82c3546d6207 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:15:54 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8af3fc1-b35c-439e-b855-1d596bc48611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7bb135-1798-4945-a0af-6488a108a8ae', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:54 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 1073741824 Apr 29 19:15:54 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df946d49-4d57-4f7b-ba74-2aa91bb7f786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:54 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Volume volume-5d7bb135-1798-4945-a0af-6488a108a8ae (5d7bb135-1798-4945-a0af-6488a108a8ae): created successfully Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df946d49-4d57-4f7b-ba74-2aa91bb7f786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Flow 'volume_create_manager' (ae74607e-e87f-4eeb-9827-a7ea0b2383c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-96b96538-82c5-4f35-be46-c4875551440b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created volume successfully. Apr 29 19:15:54 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3" returned: 0 in 0.606s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-quobyte-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3" released by "delete_volume" :: held 1.516s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Created reservations ['d0d8307c-c3da-489f-a395-9e4185d52ba9', '193a82bc-440c-4612-8a71-020451f6a0e5', '070f416e-c5e1-4f8f-a6ac-61639b2ce2fc', '40a2dfca-1b8c-481e-8a67-a5784008dbc8'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:54 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-5d7bb135-1798-4945-a0af-6488a108a8ae-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:54 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-5d7bb135-1798-4945-a0af-6488a108a8ae-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-quobyte-5d7bb135-1798-4945-a0af-6488a108a8ae" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-5d7bb135-1798-4945-a0af-6488a108a8ae" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f8062-5d18-456a-9eda-40adcd2b9395]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:54 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae Apr 29 19:15:54 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:55 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 1073741824" returned: 0 in 1.211s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:55 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 Apr 29 19:15:55 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:55 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.197s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:55 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:55 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Deleted volume successfully. Apr 29 19:15:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b9299af9-ac8d-426d-b14a-c8a2daf35b3e tempest-CreateVolumesFromImageTest-1916671186 None] Lock "cinder-89f56bd1-7db5-4be5-ba8d-2c2f562d0bd3-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:56 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae" returned: 0 in 1.313s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:56 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae Apr 29 19:15:56 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:56 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207" returned: 0 in 1.115s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba01b04b-51e7-46d5-84c2-45099def8b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8f1181-1467-41c7-8d61-82c3546d6207', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba082fd5-5bc2-4493-984f-ef60a30c418e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:15:56 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Volume volume-3e8f1181-1467-41c7-8d61-82c3546d6207 (3e8f1181-1467-41c7-8d61-82c3546d6207): created successfully Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba082fd5-5bc2-4493-984f-ef60a30c418e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:15:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Flow 'volume_create_manager' (23ff447e-1229-4a16-bc6a-f73d1443db4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:15:56 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a28466aa-c370-4599-bafa-a103bc939c82 tempest-GroupSnapshotsTest-1557513588 None] Created volume successfully. Apr 29 19:15:57 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5d7bb135-1798-4945-a0af-6488a108a8ae" returned: 0 in 0.957s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-5d7bb135-1798-4945-a0af-6488a108a8ae" released by "delete_volume" :: held 2.382s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created reservations ['1e7bdfe4-4531-4d1a-becd-adcd932a59c5', '25029111-2661-4f53-9816-6f7ad3848904', '6a1aa548-f709-43ef-a1f8-81ca709a1b2b', 'fb84186e-a63f-4f3f-9ae6-699653ef918a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:57 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:15:57 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:57 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] GroupSnapshot eb6b48e4-af65-41c9-b6cb-4eee5dac0f30: creating. Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Group snapshot eb6b48e4-af65-41c9-b6cb-4eee5dac0f30: creating. {{(pid=84523) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Creating offline snapshot 78623228-580c-4144-bd3c-cae26106882f of volume 3e8f1181-1467-41c7-8d61-82c3546d6207 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af6efe4-6d2f-4434-96d7-b206fadf252d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:57 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 Apr 29 19:15:57 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-c0bfe1a8-a1db-44dd-864c-9f5e03757248-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-c0bfe1a8-a1db-44dd-864c-9f5e03757248-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-quobyte-c0bfe1a8-a1db-44dd-864c-9f5e03757248" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-c0bfe1a8-a1db-44dd-864c-9f5e03757248" acquired by "delete_volume" :: waited 0.047s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc0b345-056c-49ae-9f84-b2bb42b2f715]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:58 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 Apr 29 19:15:58 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:58 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.308s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:15:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Deleted volume successfully. Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9d50efa2-08b5-4660-8167-d1d209737457 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-5d7bb135-1798-4945-a0af-6488a108a8ae-delete_volume" released by "delete_volume" :: held 4.087s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-51b466af-306e-457e-81bd-036bc809870b tempest-VolumesActionsTest-1471295530 None] Acquiring lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" by "attach_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-51b466af-306e-457e-81bd-036bc809870b tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" acquired by "attach_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-51b466af-306e-457e-81bd-036bc809870b tempest-VolumesActionsTest-1471295530 None] Attaching volume cb3acfc3-0a8a-4767-934b-378f7d8c16f9 to instance e95be0bc-7ee1-4366-9620-1e97cad75b8c at mountpoint /dev/vdb on host None. Apr 29 19:15:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-51b466af-306e-457e-81bd-036bc809870b tempest-VolumesActionsTest-1471295530 None] Attach volume completed successfully. Apr 29 19:15:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-51b466af-306e-457e-81bd-036bc809870b tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" released by "attach_volume" :: held 0.108s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:59 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207" returned: 0 in 1.387s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:59 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f 1G Apr 29 19:15:59 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:59 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248" returned: 0 in 0.874s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:59 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248 Apr 29 19:15:59 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-53b1e623-68b0-40c8-b105-f50c543c3663 tempest-VolumesActionsTest-1471295530 None] Acquiring lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-detach_volume" by "detach_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-53b1e623-68b0-40c8-b105-f50c543c3663 tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:15:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-53b1e623-68b0-40c8-b105-f50c543c3663 tempest-VolumesActionsTest-1471295530 None] Detaching volume cb3acfc3-0a8a-4767-934b-378f7d8c16f9 from instance e95be0bc-7ee1-4366-9620-1e97cad75b8c. Apr 29 19:15:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-53b1e623-68b0-40c8-b105-f50c543c3663 tempest-VolumesActionsTest-1471295530 None] Detach volume completed successfully. Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-53b1e623-68b0-40c8-b105-f50c543c3663 tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:15:59 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f 1G" returned: 0 in 0.855s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:15:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8f1181-1467-41c7-8d61-82c3546d6207 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:15:59 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8f1181-1467-41c7-8d61-82c3546d6207 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f Apr 29 19:15:59 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:00 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0bfe1a8-a1db-44dd-864c-9f5e03757248" returned: 0 in 0.695s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-c0bfe1a8-a1db-44dd-864c-9f5e03757248" released by "delete_volume" :: held 1.643s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created reservations ['eb9f88d7-b052-4f0c-9aad-a6e2ce350003', '76001e20-058a-4322-91da-2b6012166bcc', '1f8019ae-cd1e-428d-b721-eedbe31032a7', '507b4d24-a243-4f6c-bcb6-7126d864f7cc'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:00 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:00 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-ac1803df-9c79-4617-a0d4-b1965a4f3973-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-ac1803df-9c79-4617-a0d4-b1965a4f3973-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:00 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8f1181-1467-41c7-8d61-82c3546d6207 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f" returned: 0 in 0.861s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:00 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-quobyte-ac1803df-9c79-4617-a0d4-b1965a4f3973" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-ac1803df-9c79-4617-a0d4-b1965a4f3973" acquired by "delete_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:00 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f Apr 29 19:16:00 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ef5f0-978b-4636-a660-7468191ca948]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:00 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 Apr 29 19:16:00 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:01 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.756s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:01 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Deleted volume successfully. Apr 29 19:16:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7378f7cb-11ef-49f0-9215-3b956f9e492e tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-c0bfe1a8-a1db-44dd-864c-9f5e03757248-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:01 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f" returned: 0 in 0.809s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:01 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.info Apr 29 19:16:01 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:01 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973" returned: 0 in 1.014s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:01 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973 Apr 29 19:16:01 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:02 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.info" returned: 0 in 0.796s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:02 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:02 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.info Apr 29 19:16:02 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:02 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-ac1803df-9c79-4617-a0d4-b1965a4f3973" returned: 0 in 0.655s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-ac1803df-9c79-4617-a0d4-b1965a4f3973" released by "delete_volume" :: held 1.711s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created reservations ['ad23ff7c-9fdc-40cb-ab89-0ec4fd9e0c31', '080fb2ed-b131-4664-8ace-e68357a6ee7a', '5eed851c-72af-40b4-bbd5-5463b2075975', '033b7115-dff2-41bb-a752-5b267b3240c6'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:02 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:02 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-6e2c49d5-b4c6-498e-9512-6c988afac56b-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-6e2c49d5-b4c6-498e-9512-6c988afac56b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:03 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.info" returned: 0 in 0.640s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.506s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-quobyte-6e2c49d5-b4c6-498e-9512-6c988afac56b" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-6e2c49d5-b4c6-498e-9512-6c988afac56b" acquired by "delete_volume" :: waited 0.038s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a2c1e-7365-4ddc-a912-cccfa9276c95]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:03 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9b6dc27a-afaf-4e6e-9cb5-f3b143c5323e tempest-GroupSnapshotsTest-1557513588 None] group_snapshot eb6b48e4-af65-41c9-b6cb-4eee5dac0f30: created successfully Apr 29 19:16:03 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b Apr 29 19:16:03 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:03 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.737s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:03 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Deleted volume successfully. Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-785845c6-61ff-48f8-ad12-bee8fc323c89 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-ac1803df-9c79-4617-a0d4-b1965a4f3973-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:03 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b" returned: 0 in 0.756s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:04 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b Apr 29 19:16:04 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:04 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] group_snapshot eb6b48e4-af65-41c9-b6cb-4eee5dac0f30: deleting Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] group_snapshot eb6b48e4-af65-41c9-b6cb-4eee5dac0f30: deleting {{(pid=84523) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-3e8f1181-1467-41c7-8d61-82c3546d6207" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-3e8f1181-1467-41c7-8d61-82c3546d6207" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-78623228-580c-4144-bd3c-cae26106882f" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-78623228-580c-4144-bd3c-cae26106882f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Deleting offline snapshot 78623228-580c-4144-bd3c-cae26106882f of volume 3e8f1181-1467-41c7-8d61-82c3546d6207 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] snapshot_file for this snap is: volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8521a2-48e7-4a05-86df-c3ca6a08549d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:04 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f Apr 29 19:16:04 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:04 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6e2c49d5-b4c6-498e-9512-6c988afac56b" returned: 0 in 0.638s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-6e2c49d5-b4c6-498e-9512-6c988afac56b" released by "delete_volume" :: held 1.460s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created reservations ['af16d1f9-dcd5-4e84-8f26-52db4839d617', 'd18a6276-fcca-467b-bb0a-a74673357fbc', '59bdca9c-fdea-4ac6-8fcd-3c29f9ba3962', '8e302455-ed43-4eaf-bf7c-de3f84c3c707'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:04 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:04 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:05 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f" returned: 0 in 0.731s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e8f1181-1467-41c7-8d61-82c3546d6207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a8dd06-876d-4372-84e3-50d118703202]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:05 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 Apr 29 19:16:05 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-4e59709b-9b46-4025-8d44-bf2b7bbe06b3-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-4e59709b-9b46-4025-8d44-bf2b7bbe06b3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-quobyte-4e59709b-9b46-4025-8d44-bf2b7bbe06b3" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-4e59709b-9b46-4025-8d44-bf2b7bbe06b3" acquired by "delete_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d111c37-5c44-4847-9940-edbc2408f61d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:05 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.673s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:05 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Deleted volume successfully. Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-280e3a5a-fe88-4a00-9f03-8942fa584ebf tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-6e2c49d5-b4c6-498e-9512-6c988afac56b-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:05 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 Apr 29 19:16:05 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:05 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207" returned: 0 in 0.769s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:05 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f Apr 29 19:16:05 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:06 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3" returned: 0 in 0.808s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:06 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3 Apr 29 19:16:06 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:06 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f" returned: 0 in 0.713s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:06 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f Apr 29 19:16:06 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:06 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4e59709b-9b46-4025-8d44-bf2b7bbe06b3" returned: 0 in 0.684s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:06 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-4e59709b-9b46-4025-8d44-bf2b7bbe06b3" released by "delete_volume" :: held 1.541s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:06 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created reservations ['69fc9a7f-5ce1-406f-84dc-96a3ca486156', '4b36b51f-d81d-46fa-83ad-a1f6a917a3b0', '8f5bca76-8267-430a-abcf-4efa01974534', '37a39214-55db-4902-925d-56f181bc3194'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:07 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:07 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:07 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207.78623228-580c-4144-bd3c-cae26106882f" returned: 0 in 0.640s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-78623228-580c-4144-bd3c-cae26106882f" released by "_delete_snapshot" :: held 2.969s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-3e8f1181-1467-41c7-8d61-82c3546d6207" released by "delete_snapshot" :: held 2.996s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:07 devstack cinder-volume[84523]: WARNING cinder.quota [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-983703536 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-983703536, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:16:07 devstack cinder-volume[84523]: WARNING cinder.quota [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-983703536 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-983703536, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['c7091d33-f4a1-407a-81f2-b4de2eab7ba1', '334e1667-bea1-4a98-8841-d84218be07b8', 'a8de2dac-b657-4eca-8a55-2e90658a5de1', 'e1ef8ce7-f3c5-4a28-b95d-e934c8d963fa'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-613480d9-d43c-4428-ba97-17f39635dd2f tempest-GroupSnapshotsTest-1557513588 None] group_snapshot eb6b48e4-af65-41c9-b6cb-4eee5dac0f30: deleted successfully Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-52d59c4a-c985-4624-8725-6ffedca8f947-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-52d59c4a-c985-4624-8725-6ffedca8f947-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "cinder-quobyte-52d59c4a-c985-4624-8725-6ffedca8f947" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:07 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.631s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Deleted volume successfully. Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-52d59c4a-c985-4624-8725-6ffedca8f947" acquired by "delete_volume" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2d725484-387b-45e6-a0a5-331999390554 tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-4e59709b-9b46-4025-8d44-bf2b7bbe06b3-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff19263e-0624-4e71-a15c-d0295e8cac4b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "cinder-quobyte-3e8f1181-1467-41c7-8d61-82c3546d6207" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:07 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 Apr 29 19:16:07 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-3e8f1181-1467-41c7-8d61-82c3546d6207" acquired by "delete_volume" :: waited 0.023s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8d6473-d037-4e91-b919-295bd640906e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:08 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 Apr 29 19:16:08 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:08 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947" returned: 0 in 0.807s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:08 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947 Apr 29 19:16:08 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:08 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207" returned: 0 in 0.813s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:08 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207 Apr 29 19:16:08 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:09 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-52d59c4a-c985-4624-8725-6ffedca8f947" returned: 0 in 0.630s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-quobyte-52d59c4a-c985-4624-8725-6ffedca8f947" released by "delete_volume" :: held 1.489s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Created reservations ['5d46ad79-e6a1-42aa-8ec0-cb4232564b03', 'f587c8dd-b3a4-47ce-8b3d-5d712ade340e', '085d51d2-2f2b-4570-948e-6ef77a184ec0', '57726f14-13c9-48ea-81b9-39623c53dfdb'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:09 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:09 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:09 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3e8f1181-1467-41c7-8d61-82c3546d6207" returned: 0 in 0.659s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Lock "cinder-quobyte-3e8f1181-1467-41c7-8d61-82c3546d6207" released by "delete_volume" :: held 1.565s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['ef4738ed-12ac-4798-9c72-65237f3ea7fc'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:09 devstack cinder-volume[84523]: WARNING cinder.quota [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-983703536 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-983703536, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf78f6c-fe40-41d2-97d4-58bd416f319d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Created reservations ['1e41012c-1af3-40d5-9027-40ae849f3405', '0cf6ebad-4866-4c9c-9b1c-f78357bdded1', 'b0cbe10b-3b79-4f06-b952-5b969adc7181', '387d712d-01a2-4037-a73c-9728415783a6'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:09 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:16:09 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:09 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:09 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:09 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.648s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:09 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Deleted volume successfully. Apr 29 19:16:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3860d2c4-8fce-458d-99f9-8a8b2977381b tempest-CreateVolumesFromSourceVolumeTest-722278581 None] Lock "cinder-52d59c4a-c985-4624-8725-6ffedca8f947-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:10 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.823s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:10 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab085754-913f-417e-b2ef-b826853d7ab1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:10 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.710s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:10 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-88b14d2a-ceb0-45e1-9459-639bdb77f5c8 tempest-GroupSnapshotsTest-1557513588 None] Delete group completed successfully. Apr 29 19:16:10 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:16:10 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:11 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.862s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.1c983a2f-f4cd-4b4a-bed3-2800d7071a8a16mna9z5.img {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:11 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.1c983a2f-f4cd-4b4a-bed3-2800d7071a8a16mna9z5.img Apr 29 19:16:11 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:16 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.1c983a2f-f4cd-4b4a-bed3-2800d7071a8a16mna9z5.img" returned: 0 in 5.241s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:16 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[595eda22-37fe-42c1-9e5b-38aff33f2292]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:16 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:16:16 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:17 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.895s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:17 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.1c983a2f-f4cd-4b4a-bed3-2800d7071a8a16mna9z5.img {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:16:17 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Converted 1024.00 MB image at 195.32 MB/s Apr 29 19:16:17 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:DELETE=19,cinder:SELECT=213,cinder:UPDATE=261,cinder:INSERT=56 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:16:17 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] 1c983a2f-f4cd-4b4a-bed3-2800d7071a8a was raw, no need to convert to raw {{(pid=84523) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 19:16:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0b7fac7a-0be8-4a8f-8ef2-d6d2376b86f2 tempest-GroupsTest-1518205157 None] Group tempest-Group1-694652347: creating Apr 29 19:16:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0b7fac7a-0be8-4a8f-8ef2-d6d2376b86f2 tempest-GroupsTest-1518205157 None] Group tempest-Group1-694652347: created successfully Apr 29 19:16:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0b7fac7a-0be8-4a8f-8ef2-d6d2376b86f2 tempest-GroupsTest-1518205157 None] Create group completed successfully. Apr 29 19:16:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-442f23b4-78b0-4077-bf85-d289a5b356d9 tempest-GroupsTest-1518205157 None] Group tempest-Group2-1368327678: creating Apr 29 19:16:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-442f23b4-78b0-4077-bf85-d289a5b356d9 tempest-GroupsTest-1518205157 None] Group tempest-Group2-1368327678: created successfully Apr 29 19:16:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-442f23b4-78b0-4077-bf85-d289a5b356d9 tempest-GroupsTest-1518205157 None] Create group completed successfully. Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Flow 'volume_create_manager' (147d52fc-437e-4f5f-b91b-bebbfa361df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880b6023-a7fc-4a1c-871d-4e71c2ab8674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880b6023-a7fc-4a1c-871d-4e71c2ab8674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-417165688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52294df4-6195-452a-b818-f32d2b5eaeca,host='devstack@QuobyteHD#QuobyteHD',id=3c0a5b40-b431-4942-b0fc-c47a5babd8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284431b778eb43df931f88819c9fb507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:16:20Z,use_quota=True,user_id='82409e02e8554f9ab95d2edd52b5172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac029fa8-096b-4bef-9ebe-71320bbb283d),volume_type_id=ac029fa8-096b-4bef-9ebe-71320bbb283d)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1dd2ea-2dbd-4792-a40e-8e902eadcf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1dd2ea-2dbd-4792-a40e-8e902eadcf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e3f198-4dab-40e9-9908-a7b4eb873443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e3f198-4dab-40e9-9908-a7b4eb873443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0a5b40-b431-4942-b0fc-c47a5babd8d0', 'volume_name': 'volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2466c706-262d-4b59-9f69-4bf7c3a43c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2466c706-262d-4b59-9f69-4bf7c3a43c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935973c8-c6d9-4898-a951-60346e1efaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:20 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Volume 3c0a5b40-b431-4942-b0fc-c47a5babd8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0', 'volume_size': 1} Apr 29 19:16:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:16:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:29 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:29 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:30 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=177,cinder:DELETE=10,cinder:SELECT=125,cinder:INSERT=42 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:16:30 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:16:30 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.699s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:16:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:16:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.390s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Uploaded volume to glance image-id: 1c983a2f-f4cd-4b4a-bed3-2800d7071a8a. {{(pid=84523) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.395s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52294df4-6195-452a-b818-f32d2b5eaeca,created_at=2026-04-29T17:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-417165688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52294df4-6195-452a-b818-f32d2b5eaeca,host='devstack@QuobyteHD#QuobyteHD',id=3c0a5b40-b431-4942-b0fc-c47a5babd8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284431b778eb43df931f88819c9fb507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:16:20Z,use_quota=True,user_id='82409e02e8554f9ab95d2edd52b5172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac029fa8-096b-4bef-9ebe-71320bbb283d),volume_type_id=ac029fa8-096b-4bef-9ebe-71320bbb283d)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Creating volume 3c0a5b40-b431-4942-b0fc-c47a5babd8d0 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:16:36 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:16:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:36 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 1073741824 Apr 29 19:16:36 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c5f43604-def8-4fc7-9510-07c4ee1def9c tempest-VolumesActionsTest-1471295530 None] Copy volume to image completed successfully. Apr 29 19:16:37 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 1073741824" returned: 0 in 0.766s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:37 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 Apr 29 19:16:37 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:38 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0" returned: 0 in 0.599s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935973c8-c6d9-4898-a951-60346e1efaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66403934-f790-4963-97a9-55a100e01f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:38 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Volume volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 (3c0a5b40-b431-4942-b0fc-c47a5babd8d0): created successfully Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66403934-f790-4963-97a9-55a100e01f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Flow 'volume_create_manager' (147d52fc-437e-4f5f-b91b-bebbfa361df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:16:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-8bab8167-2c10-4b0e-aad4-a9fd42d3d7a1 tempest-GroupsTest-1518205157 None] Created volume successfully. Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf4397-45c2-47d7-82be-c226242fbb95]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:38 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:16:38 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:39 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.724s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c4ae73-5f4f-467e-9da5-be33bbcbd26c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Acquiring lock "cinder-quobyte-3c0a5b40-b431-4942-b0fc-c47a5babd8d0" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Lock "cinder-quobyte-3c0a5b40-b431-4942-b0fc-c47a5babd8d0" acquired by "delete_volume" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:39 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffecb9c-bdf2-4e7a-a7fc-a06e332d309d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:39 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:16:39 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:39 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 Apr 29 19:16:39 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:40 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.716s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:40 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img Apr 29 19:16:40 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:40 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0" returned: 0 in 0.704s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:40 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0 Apr 29 19:16:40 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:41 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3c0a5b40-b431-4942-b0fc-c47a5babd8d0" returned: 0 in 1.015s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Lock "cinder-quobyte-3c0a5b40-b431-4942-b0fc-c47a5babd8d0" released by "delete_volume" :: held 1.803s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Created reservations ['b040f67d-7e07-4b5f-9eb5-939683b49d6d'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:41 devstack cinder-volume[84523]: WARNING cinder.quota [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2016814034 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2016814034, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:16:41 devstack cinder-volume[84523]: WARNING cinder.quota [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2016814034 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2016814034, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Created reservations ['f6609a17-c272-4d50-8b12-59058e0fff3a', 'deb33d94-67b7-4126-a5cc-05de18a593a9', '6602176f-88e1-42fb-b0b0-32d1e6012f35', '1531733b-9da2-4ded-b5e1-79ee9a7e4da4'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:42 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:42 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Created reservations ['1caac390-841c-433a-b1ed-c8d2deacd3b2'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:43 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.435s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:43 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ff025e7f-bfb6-4f35-978b-85e46a7ccdeb tempest-GroupsTest-1518205157 None] Delete group completed successfully. Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:43 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:43 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:44 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.368s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:44 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:44 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f85bdcb4-65bf-4c7f-b39c-32d74ee4b55b tempest-GroupsTest-1518205157 None] Delete group completed successfully. Apr 29 19:16:45 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img" returned: 0 in 5.010s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:45 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e894c7-05a8-47c4-9606-31a817b43aea]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b70f73be-ff3d-41ce-9220-d111a6a32d32 tempest-GroupsTest-1518205157 None] Group tempest-GroupsTest-Group-1509776820: creating Apr 29 19:16:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b70f73be-ff3d-41ce-9220-d111a6a32d32 tempest-GroupsTest-1518205157 None] Group tempest-GroupsTest-Group-1509776820: created successfully Apr 29 19:16:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b70f73be-ff3d-41ce-9220-d111a6a32d32 tempest-GroupsTest-1518205157 None] Create group completed successfully. Apr 29 19:16:45 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:16:45 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:45 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.841s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:45 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:16:45 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Converted 1024.00 MB image at 204.33 MB/s Apr 29 19:16:45 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] e483478c-654d-4339-b43f-56e464e1f524 was raw, converting to qcow2 {{(pid=84523) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 19:16:45 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b1562e-fdb9-4011-b973-384cd4f88ecd]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:46 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img Apr 29 19:16:46 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:46 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img" returned: 0 in 0.669s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Flow 'volume_create_manager' (890b87de-ced2-4283-805f-b61c84534955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46945d3b-6d7d-41bd-9915-2a08350e2990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46945d3b-6d7d-41bd-9915-2a08350e2990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1913253389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efb6b1ec-b000-46d5-8274-d48fa02e44f4,host='devstack@QuobyteHD#QuobyteHD',id=02442b8e-9f8a-4ccf-975f-8f21ebf76105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284431b778eb43df931f88819c9fb507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:16:47Z,use_quota=True,user_id='82409e02e8554f9ab95d2edd52b5172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54b08912-95b9-47ce-bf99-8de497f34055),volume_type_id=54b08912-95b9-47ce-bf99-8de497f34055)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6200b864-a7ca-472a-8e2d-6b5352f6673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6200b864-a7ca-472a-8e2d-6b5352f6673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643aba62-d13f-4345-b2d0-277480bda46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643aba62-d13f-4345-b2d0-277480bda46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02442b8e-9f8a-4ccf-975f-8f21ebf76105', 'volume_name': 'volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fbaa78-06e6-42f6-a929-8beb72fec958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fbaa78-06e6-42f6-a929-8beb72fec958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:46 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img Apr 29 19:16:46 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d9fe07-1cc1-4774-a218-91dae5e76aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:46 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Volume 02442b8e-9f8a-4ccf-975f-8f21ebf76105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105', 'volume_size': 1} Apr 29 19:16:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:47 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img" returned: 1 in 0.662s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:16:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img /opt/stack/data/cinder/conversion/vol_upload_otgp6coy {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:47 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img /opt/stack/data/cinder/conversion/vol_upload_otgp6coy Apr 29 19:16:47 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:47 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img /opt/stack/data/cinder/conversion/vol_upload_otgp6coy" returned: 0 in 0.629s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:47 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Image conversion details: src /opt/stack/data/cinder/conversion/cb3acfc3-0a8a-4767-934b-378f7d8c16f9.temp_image.e483478c-654d-4339-b43f-56e464e1f524ucr5h3hw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_otgp6coy {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:16:47 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 19:16:47 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bef14f9-5434-4130-900a-4aea43611235]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_otgp6coy {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:48 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_otgp6coy Apr 29 19:16:48 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:48 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_otgp6coy" returned: 0 in 0.676s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.162s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Uploaded volume to glance image-id: e483478c-654d-4339-b43f-56e464e1f524. {{(pid=84523) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=efb6b1ec-b000-46d5-8274-d48fa02e44f4,created_at=2026-04-29T17:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1913253389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efb6b1ec-b000-46d5-8274-d48fa02e44f4,host='devstack@QuobyteHD#QuobyteHD',id=02442b8e-9f8a-4ccf-975f-8f21ebf76105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284431b778eb43df931f88819c9fb507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:16:47Z,use_quota=True,user_id='82409e02e8554f9ab95d2edd52b5172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54b08912-95b9-47ce-bf99-8de497f34055),volume_type_id=54b08912-95b9-47ce-bf99-8de497f34055)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Creating volume 02442b8e-9f8a-4ccf-975f-8f21ebf76105 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:16:49 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:16:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:49 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 1073741824 Apr 29 19:16:49 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f9e8c819-67b9-4d54-92af-d4774a240ebb tempest-VolumesActionsTest-1471295530 None] Copy volume to image completed successfully. Apr 29 19:16:49 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:50 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 1073741824" returned: 0 in 0.762s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:50 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 Apr 29 19:16:50 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Acquiring lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Acquiring lock "cinder-quobyte-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Lock "cinder-quobyte-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:50 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3821f6f-56c0-4b77-8099-abecdea389eb]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:51 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:16:51 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:51 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105" returned: 0 in 0.638s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d9fe07-1cc1-4774-a218-91dae5e76aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcad0b66-3cc4-4e99-aabd-be0cb68b5484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Volume volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 (02442b8e-9f8a-4ccf-975f-8f21ebf76105): created successfully Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcad0b66-3cc4-4e99-aabd-be0cb68b5484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Flow 'volume_create_manager' (890b87de-ced2-4283-805f-b61c84534955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:16:51 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-37248465-c4fe-4c89-9a12-6aae080ef2a7 tempest-GroupsTest-1518205157 None] Created volume successfully. Apr 29 19:16:51 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.708s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:51 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9 Apr 29 19:16:51 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:52 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" returned: 0 in 0.598s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Lock "cinder-quobyte-cb3acfc3-0a8a-4767-934b-378f7d8c16f9" released by "delete_volume" :: held 1.345s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Created reservations ['00e0c513-21c1-40f2-83d4-8b99c1593c83', '652450a4-4e80-4ce8-b593-4db3045e2717', '175d4bed-49a7-4b01-92dc-1f6364ab2bc2', '729ea2a8-3fd0-4e0b-b3f3-4d22bc988f0f'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:52 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:16:52 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Flow 'volume_create_manager' (6834796c-c9a7-4302-bf78-0cfcacdc6ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4364ec-cc4c-486c-9bfe-44c75e203958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4364ec-cc4c-486c-9bfe-44c75e203958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533660012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efb6b1ec-b000-46d5-8274-d48fa02e44f4,host='devstack@QuobyteHD#QuobyteHD',id=cdfb827d-35b3-42f9-84c8-134272abf14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284431b778eb43df931f88819c9fb507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:16:53Z,use_quota=True,user_id='82409e02e8554f9ab95d2edd52b5172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54b08912-95b9-47ce-bf99-8de497f34055),volume_type_id=54b08912-95b9-47ce-bf99-8de497f34055)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1930003d-4086-4317-8eb9-d1580c0e8bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1930003d-4086-4317-8eb9-d1580c0e8bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59d4bca-1b89-43e2-b37c-cc912f409744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59d4bca-1b89-43e2-b37c-cc912f409744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfb827d-35b3-42f9-84c8-134272abf14f', 'volume_name': 'volume-cdfb827d-35b3-42f9-84c8-134272abf14f', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d080a4-9e96-43d6-b0b4-bc0df384c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d080a4-9e96-43d6-b0b4-bc0df384c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c1d4a4-e85a-46c1-af5b-057c31d428e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:52 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Volume cdfb827d-35b3-42f9-84c8-134272abf14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfb827d-35b3-42f9-84c8-134272abf14f', 'volume_size': 1} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=efb6b1ec-b000-46d5-8274-d48fa02e44f4,created_at=2026-04-29T17:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533660012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=efb6b1ec-b000-46d5-8274-d48fa02e44f4,host='devstack@QuobyteHD#QuobyteHD',id=cdfb827d-35b3-42f9-84c8-134272abf14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284431b778eb43df931f88819c9fb507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:16:53Z,use_quota=True,user_id='82409e02e8554f9ab95d2edd52b5172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54b08912-95b9-47ce-bf99-8de497f34055),volume_type_id=54b08912-95b9-47ce-bf99-8de497f34055)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Creating volume cdfb827d-35b3-42f9-84c8-134272abf14f {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:16:52 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:52 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f 1073741824 Apr 29 19:16:52 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:52 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.635s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:52 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:16:52 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Deleted volume successfully. Apr 29 19:16:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cb5e3738-279f-4904-980b-c2d29e4fe349 tempest-VolumesActionsTest-1471295530 None] Lock "cinder-cb3acfc3-0a8a-4767-934b-378f7d8c16f9-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:53 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f 1073741824" returned: 0 in 0.833s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:53 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f Apr 29 19:16:53 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:54 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f" returned: 0 in 0.627s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:16:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c1d4a4-e85a-46c1-af5b-057c31d428e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfb827d-35b3-42f9-84c8-134272abf14f', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36e70bf-56a4-4de9-a556-b16a776e8c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:54 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Volume volume-cdfb827d-35b3-42f9-84c8-134272abf14f (cdfb827d-35b3-42f9-84c8-134272abf14f): created successfully Apr 29 19:16:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36e70bf-56a4-4de9-a556-b16a776e8c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Flow 'volume_create_manager' (6834796c-c9a7-4302-bf78-0cfcacdc6ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:16:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-df91e91a-364e-4506-a0e1-0758c9b25973 tempest-GroupsTest-1518205157 None] Created volume successfully. Apr 29 19:16:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-32a7ea6f-5a0d-4df0-b33f-ee5117cb7113 tempest-GroupsTest-1518205157 None] Update group completed successfully. Apr 29 19:16:56 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0711133b-ea64-4e00-8b15-b2b87e60d511 tempest-GroupsTest-1518205157 None] Update group completed successfully. Apr 29 19:16:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Acquiring lock "cinder-quobyte-02442b8e-9f8a-4ccf-975f-8f21ebf76105" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Lock "cinder-quobyte-02442b8e-9f8a-4ccf-975f-8f21ebf76105" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:57 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f277e0-3582-4c5b-a543-e2e393998e6f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:57 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 Apr 29 19:16:57 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Flow 'volume_create_manager' (517e8802-e986-4e1f-890c-0cc3d4f51858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3259ab-89f7-4ae4-b0a9-8da717cf8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3259ab-89f7-4ae4-b0a9-8da717cf8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1088853931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc48fd7a-ffc4-49ae-b0d5-82197667d7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91593963ccb8412db97ae000a9b99ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:16:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:16:58Z,use_quota=True,user_id='41e807edd64444bda3eafbf5a1a16f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:58 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d54cdac-f231-4ec4-8073-28809810fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d54cdac-f231-4ec4-8073-28809810fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55def436-0e36-493e-93e8-0c3590988252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55def436-0e36-493e-93e8-0c3590988252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc48fd7a-ffc4-49ae-b0d5-82197667d7a1', 'volume_name': 'volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1', 'volume_size': 2}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6d747c-8739-477b-9a51-f0a9b307c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6d747c-8739-477b-9a51-f0a9b307c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb0e98d-2c7e-42d1-9b5c-7a2ca303095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:58 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Volume cc48fd7a-ffc4-49ae-b0d5-82197667d7a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1', 'volume_size': 2} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1088853931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc48fd7a-ffc4-49ae-b0d5-82197667d7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91593963ccb8412db97ae000a9b99ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:16:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:16:58Z,use_quota=True,user_id='41e807edd64444bda3eafbf5a1a16f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Creating volume cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:16:58 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 2147483648 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105" returned: 0 in 0.818s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:58 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 2147483648 Apr 29 19:16:58 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:58 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105 Apr 29 19:16:58 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:59 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-02442b8e-9f8a-4ccf-975f-8f21ebf76105" returned: 0 in 0.600s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Lock "cinder-quobyte-02442b8e-9f8a-4ccf-975f-8f21ebf76105" released by "delete_volume" :: held 1.472s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Acquiring lock "cinder-quobyte-cdfb827d-35b3-42f9-84c8-134272abf14f" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Lock "cinder-quobyte-cdfb827d-35b3-42f9-84c8-134272abf14f" acquired by "delete_volume" :: waited 0.012s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fd42e6-371d-43b7-b08b-9dd1110a894b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:59 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f Apr 29 19:16:59 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:59 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 2147483648" returned: 0 in 0.820s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:59 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 Apr 29 19:16:59 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:59 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f" returned: 0 in 0.709s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:16:59 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f Apr 29 19:16:59 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:16:59 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1" returned: 0 in 0.599s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb0e98d-2c7e-42d1-9b5c-7a2ca303095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1', 'volume_size': 2}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:16:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3646d265-d6c3-4744-b7a7-4c4d56884aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:16:59 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Volume volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 (cc48fd7a-ffc4-49ae-b0d5-82197667d7a1): created successfully Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3646d265-d6c3-4744-b7a7-4c4d56884aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Flow 'volume_create_manager' (517e8802-e986-4e1f-890c-0cc3d4f51858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:00 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2ada5b07-d8f7-4cdf-8029-29c0320de697 tempest-VolumesCloneNegativeTest-1521879763 None] Created volume successfully. Apr 29 19:17:00 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cdfb827d-35b3-42f9-84c8-134272abf14f" returned: 0 in 0.600s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Lock "cinder-quobyte-cdfb827d-35b3-42f9-84c8-134272abf14f" released by "delete_volume" :: held 1.354s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Created reservations ['ade90316-f493-46a1-b096-055e37cd7966'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:00 devstack cinder-volume[84523]: WARNING cinder.quota [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1882433665 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1882433665, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:17:00 devstack cinder-volume[84523]: WARNING cinder.quota [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1882433665 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1882433665, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Created reservations ['ae802fa5-04ff-4127-ad75-ed8a8400b52a', 'aa160de2-b773-47d6-9b49-d6ba3b16b7f7', '42657dff-daf2-432b-8215-f5899851f451', '334e6273-d397-410f-bb25-7f3a4385082c'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Acquiring lock "cinder-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "cinder-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Created reservations ['8860eeef-d581-4335-84ff-0b9afeed97fd', '5c20d9f0-643d-4898-9cae-52bb3372e0f5', '72590e00-20b9-4e05-a371-b0b298bf1829', 'b4c303b0-5290-4f28-a518-8ac360987c19'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Acquiring lock "cinder-quobyte-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "cinder-quobyte-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1" acquired by "delete_volume" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac820c81-2501-42ba-a7d5-b62a9c3436e7]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:00 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:00 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:00 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 Apr 29 19:17:00 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:01 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.631s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:01 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ed03f0d4-3ee8-4ebe-b2de-9a2f909ac1b1 tempest-GroupsTest-1518205157 None] Delete group completed successfully. Apr 29 19:17:01 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1" returned: 0 in 0.765s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:01 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1 Apr 29 19:17:01 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:02 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1" returned: 0 in 0.625s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "cinder-quobyte-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1" released by "delete_volume" :: held 1.438s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Created reservations ['67033dfb-d2ae-4302-b4e3-8011f2db8f5c', '5439b043-e30c-4440-9612-378782901fcb', '3ec1aebf-f5a5-42e7-93f1-7c0d9a517aae', 'f78a9880-e852-454a-9e0f-95e74d4132bd'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:02 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:02 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:03 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.621s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:03 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:03 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Deleted volume successfully. Apr 29 19:17:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0783603e-db8f-4304-8c60-c3fa9b799656 tempest-VolumesCloneNegativeTest-1521879763 None] Lock "cinder-cc48fd7a-ffc4-49ae-b0d5-82197667d7a1-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:05 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (f3915ad1-8c4a-4183-b47d-389e052fbe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b4ae10-e9e6-4ef9-85c2-7fbc38a6b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b4ae10-e9e6-4ef9-85c2-7fbc38a6b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1193935276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97afa0cb-ebd0-4d45-ac72-a259cf95e23e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:06Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd3c22f-6328-49dd-91ae-58f616713e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd3c22f-6328-49dd-91ae-58f616713e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb8d0fa-5e27-477d-83a4-814c1a6ad585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb8d0fa-5e27-477d-83a4-814c1a6ad585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97afa0cb-ebd0-4d45-ac72-a259cf95e23e', 'volume_name': 'volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32bd4a0-ac3b-40fa-9df9-60a62b8115dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32bd4a0-ac3b-40fa-9df9-60a62b8115dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e6999e-3a96-491e-8bcf-147625155c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:06 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Volume 97afa0cb-ebd0-4d45-ac72-a259cf95e23e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e', 'volume_size': 1} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1193935276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97afa0cb-ebd0-4d45-ac72-a259cf95e23e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:06Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Creating volume 97afa0cb-ebd0-4d45-ac72-a259cf95e23e {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:17:06 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:06 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e 1073741824 Apr 29 19:17:06 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Flow 'volume_create_manager' (c3899e60-ac1a-4aab-9e1f-9f84987331eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5ef6de-5b62-48e7-9df1-51b18ce21222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5ef6de-5b62-48e7-9df1-51b18ce21222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-96401052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e70875-d734-408d-b80f-5d8f1c2d1393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3371dc0bcd5442cc9e646860e895b76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:06Z,use_quota=True,user_id='84e8bb715fb2474b9efac1b7911ab25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67117e82-298a-429a-bf45-f05e29242bde),volume_type_id=67117e82-298a-429a-bf45-f05e29242bde)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dd853d-575b-4202-aa30-2b3c6747cd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dd853d-575b-4202-aa30-2b3c6747cd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973bdad0-81a8-40ee-8b2b-1a67d1c81a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973bdad0-81a8-40ee-8b2b-1a67d1c81a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e70875-d734-408d-b80f-5d8f1c2d1393', 'volume_name': 'volume-c7e70875-d734-408d-b80f-5d8f1c2d1393', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e89d40-b5ff-451c-966e-bbf92cc6d6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e89d40-b5ff-451c-966e-bbf92cc6d6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebce789-54dc-4251-b323-0f92fb8c15ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:06 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Volume c7e70875-d734-408d-b80f-5d8f1c2d1393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e70875-d734-408d-b80f-5d8f1c2d1393', 'volume_size': 1} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:06 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e 1073741824" returned: 0 in 0.778s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:06 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e Apr 29 19:17:06 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:07 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e" returned: 0 in 0.588s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-96401052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e70875-d734-408d-b80f-5d8f1c2d1393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3371dc0bcd5442cc9e646860e895b76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:06Z,use_quota=True,user_id='84e8bb715fb2474b9efac1b7911ab25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67117e82-298a-429a-bf45-f05e29242bde),volume_type_id=67117e82-298a-429a-bf45-f05e29242bde)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Creating volume c7e70875-d734-408d-b80f-5d8f1c2d1393 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:17:07 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e6999e-3a96-491e-8bcf-147625155c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:07 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 1073741824 Apr 29 19:17:07 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594102c3-59ad-42e0-9175-fb4797e6cee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:07 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Volume volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e (97afa0cb-ebd0-4d45-ac72-a259cf95e23e): created successfully Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594102c3-59ad-42e0-9175-fb4797e6cee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (f3915ad1-8c4a-4183-b47d-389e052fbe68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d58d4af0-46ad-4422-bf09-9aa654022b9d tempest-VolumesGetTest-1555757260 None] Created volume successfully. Apr 29 19:17:08 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 1073741824" returned: 0 in 0.771s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:08 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 Apr 29 19:17:08 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (a352d372-21c6-43bf-b3f4-e67e7f0b3256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a73e062-ce42-4003-95c8-28d7fc11ba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a73e062-ce42-4003-95c8-28d7fc11ba94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-926828631',display_name='tempest-VolumesGetTest-Volume-1527978411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3026091-a4d1-4837-b584-02b05f163248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:09Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcbba48-0bab-42b6-9a67-63a1bde0db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcbba48-0bab-42b6-9a67-63a1bde0db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4ca183-bc76-4267-b963-8c1771092a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4ca183-bc76-4267-b963-8c1771092a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3026091-a4d1-4837-b584-02b05f163248', 'volume_name': 'volume-b3026091-a4d1-4837-b584-02b05f163248', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6226a2d9-bb39-47ff-b0f4-075f59a13e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6226a2d9-bb39-47ff-b0f4-075f59a13e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6818ad-cf49-401e-b9f0-0fb86215d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:08 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Volume b3026091-a4d1-4837-b584-02b05f163248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3026091-a4d1-4837-b584-02b05f163248', 'volume_size': 1} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:08 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393" returned: 0 in 0.601s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.116s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-926828631',display_name='tempest-VolumesGetTest-Volume-1527978411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3026091-a4d1-4837-b584-02b05f163248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:09Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Creating volume b3026091-a4d1-4837-b584-02b05f163248 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:17:08 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:08 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 1073741824 Apr 29 19:17:08 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebce789-54dc-4251-b323-0f92fb8c15ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e70875-d734-408d-b80f-5d8f1c2d1393', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ad5069-d684-41d1-8fc0-0f32e69a093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:08 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Volume volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 (c7e70875-d734-408d-b80f-5d8f1c2d1393): created successfully Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ad5069-d684-41d1-8fc0-0f32e69a093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Flow 'volume_create_manager' (c3899e60-ac1a-4aab-9e1f-9f84987331eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:08 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-27dfb26c-e31d-408d-b615-ddb46c122925 tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Created volume successfully. Apr 29 19:17:09 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 1073741824" returned: 0 in 0.790s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:09 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 Apr 29 19:17:09 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:09 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:09 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:10 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248" returned: 0 in 0.593s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6818ad-cf49-401e-b9f0-0fb86215d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3026091-a4d1-4837-b584-02b05f163248', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91ec7f0-03c1-4717-81e7-78587eb6ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:10 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Volume volume-b3026091-a4d1-4837-b584-02b05f163248 (b3026091-a4d1-4837-b584-02b05f163248): created successfully Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91ec7f0-03c1-4717-81e7-78587eb6ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (a352d372-21c6-43bf-b3f4-e67e7f0b3256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:10 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.583s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b2f962fb-ea89-4586-b6c9-be5a09d6915c tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Retype volume completed successfully. Apr 29 19:17:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5d35bfc1-ca21-4965-a5b6-042c1f53ce58 tempest-VolumesGetTest-1555757260 None] Created volume successfully. Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-b3026091-a4d1-4837-b584-02b05f163248-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Lock "cinder-b3026091-a4d1-4837-b584-02b05f163248-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Acquiring lock "cinder-c7e70875-d734-408d-b80f-5d8f1c2d1393-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-b3026091-a4d1-4837-b584-02b05f163248" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "cinder-c7e70875-d734-408d-b80f-5d8f1c2d1393-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-b3026091-a4d1-4837-b584-02b05f163248" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5d2358-ecec-4515-9681-26aa234754a0]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Acquiring lock "cinder-quobyte-c7e70875-d734-408d-b80f-5d8f1c2d1393" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "cinder-quobyte-c7e70875-d734-408d-b80f-5d8f1c2d1393" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a662ef9-6745-4f75-ae48-bf46359c2281]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:11 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 Apr 29 19:17:11 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:11 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 Apr 29 19:17:11 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:11 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248" returned: 0 in 0.729s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:11 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248 Apr 29 19:17:11 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:11 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393" returned: 0 in 0.720s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:11 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393 Apr 29 19:17:11 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:12 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b3026091-a4d1-4837-b584-02b05f163248" returned: 0 in 0.630s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-b3026091-a4d1-4837-b584-02b05f163248" released by "delete_volume" :: held 1.406s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:12 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c7e70875-d734-408d-b80f-5d8f1c2d1393" returned: 0 in 0.604s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "cinder-quobyte-c7e70875-d734-408d-b80f-5d8f1c2d1393" released by "delete_volume" :: held 1.368s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:12 devstack cinder-volume[84523]: WARNING cinder.quota [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:17:12 devstack cinder-volume[84523]: WARNING cinder.quota [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Created reservations ['fbe7d68a-f962-463a-97f6-ffa6ce41bbc5', 'be8aad10-74f6-4702-8f7d-8221baed03bd', '7e8a8180-6b43-4a7c-9b08-20a983b96d04', 'e1d2e593-a438-4d24-bdcd-5c1a6e939dfa'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Created reservations ['bb3232a6-0422-4ee5-9b9f-e2bc00d30051', '37134605-3828-4e1a-950b-d8244de240af', '68218c43-31a2-4661-87c0-e982e487ff5d', '2e9c761b-e481-4e8a-a7a7-d7c12881f4cf'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:12 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:12 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:12 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:12 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:13 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.592s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:13 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Deleted volume successfully. Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f0d2631d-3b4f-409f-af22-90eec9f42a8a tempest-VolumesGetTest-1555757260 None] Lock "cinder-b3026091-a4d1-4837-b584-02b05f163248-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:13 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.623s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-97afa0cb-ebd0-4d45-ac72-a259cf95e23e-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:13 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Deleted volume successfully. Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-fa183f8c-945c-480b-9fe7-d85b780ff74e tempest-VolumeRetypeWithoutMigrationTest-2030767896 None] Lock "cinder-c7e70875-d734-408d-b80f-5d8f1c2d1393-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Lock "cinder-97afa0cb-ebd0-4d45-ac72-a259cf95e23e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-97afa0cb-ebd0-4d45-ac72-a259cf95e23e" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-97afa0cb-ebd0-4d45-ac72-a259cf95e23e" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b45ef-299f-4a76-a481-b232f999e17c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:13 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e Apr 29 19:17:13 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:14 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e" returned: 0 in 0.710s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:14 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e Apr 29 19:17:14 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:14 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-97afa0cb-ebd0-4d45-ac72-a259cf95e23e" returned: 0 in 0.624s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-97afa0cb-ebd0-4d45-ac72-a259cf95e23e" released by "delete_volume" :: held 1.378s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Created reservations ['a35442bd-b85a-472c-ae8b-dd58fb8d9a01', 'bfc740d3-88b5-47ad-ab81-7bf9e6881828', '717534ac-638a-4edd-97a6-5b667fa70380', '0a41ee45-39bf-4ec0-a3ab-6b35f205d9de'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:14 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:14 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:15 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.643s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:15 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Deleted volume successfully. Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-95c6d6f2-daeb-4836-92b5-9e0e58f00b92 tempest-VolumesGetTest-1555757260 None] Lock "cinder-97afa0cb-ebd0-4d45-ac72-a259cf95e23e-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (217c5298-6905-4eb8-9a08-0f8710a59427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e056cd0-f71f-4e35-bfe8-0271559a67cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e056cd0-f71f-4e35-bfe8-0271559a67cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-285520629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62900a67-be79-4040-8e97-c972007eabe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:16Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865d1132-c480-4fdf-ba77-c04971696a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865d1132-c480-4fdf-ba77-c04971696a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fccccc-1a30-44ef-ba35-e6a2a0397952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fccccc-1a30-44ef-ba35-e6a2a0397952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62900a67-be79-4040-8e97-c972007eabe7', 'volume_name': 'volume-62900a67-be79-4040-8e97-c972007eabe7', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ba8d01-22eb-4d58-be60-d84e806cc877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ba8d01-22eb-4d58-be60-d84e806cc877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e8fe05-8bbd-43c4-b0bd-2c79b77af4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:16 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Volume 62900a67-be79-4040-8e97-c972007eabe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62900a67-be79-4040-8e97-c972007eabe7', 'volume_size': 1} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-285520629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62900a67-be79-4040-8e97-c972007eabe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:16Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Creating volume 62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:17:16 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:16 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 1073741824 Apr 29 19:17:16 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:16 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 1073741824" returned: 0 in 0.802s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:16 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 Apr 29 19:17:16 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:17 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7" returned: 0 in 0.618s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:17:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e8fe05-8bbd-43c4-b0bd-2c79b77af4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62900a67-be79-4040-8e97-c972007eabe7', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31696110-fa03-4b3a-80b2-af0dd809ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:17 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Volume volume-62900a67-be79-4040-8e97-c972007eabe7 (62900a67-be79-4040-8e97-c972007eabe7): created successfully Apr 29 19:17:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31696110-fa03-4b3a-80b2-af0dd809ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (217c5298-6905-4eb8-9a08-0f8710a59427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-85cc8b9e-4abf-4007-ba2f-1c277f51a416 tempest-VolumesGetTest-1555757260 None] Created volume successfully. Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (c24a25ae-e203-4513-9863-43713c030424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53d1350-8dfa-4cd6-b4e5-551545b3b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53d1350-8dfa-4cd6-b4e5-551545b3b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1714658302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f0da9c-3828-4720-8f16-ea2c7e5d6a20,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=62900a67-be79-4040-8e97-c972007eabe7,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:18Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6aac41-8441-4fd0-b38e-be47fcd59f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6aac41-8441-4fd0-b38e-be47fcd59f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6b635e-695f-4167-9bae-0b366aea99d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6b635e-695f-4167-9bae-0b366aea99d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c1f0da9c-3828-4720-8f16-ea2c7e5d6a20', 'volume_name': 'volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20', 'volume_size': 1, 'source_volid': '62900a67-be79-4040-8e97-c972007eabe7', 'source_volstatus': 'available'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02985520-453c-44f3-a58f-da018ba53636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02985520-453c-44f3-a58f-da018ba53636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0846c192-44cf-4f4a-a804-243a3fcf08e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:18 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Volume c1f0da9c-3828-4720-8f16-ea2c7e5d6a20: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20', 'volume_size': 1, 'source_volid': '62900a67-be79-4040-8e97-c972007eabe7', 'source_volstatus': 'available'} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:18 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Cloning volume 62900a67-be79-4040-8e97-c972007eabe7 to volume c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Creating offline snapshot c90fb8f2-b511-4009-bac6-be360093a723 of volume 62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a7d2c1-ed5b-4106-9fce-39619087f826]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:18 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 Apr 29 19:17:18 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:19 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7" returned: 0 in 0.760s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:19 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 1G Apr 29 19:17:19 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:20 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 1G" returned: 0 in 0.840s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62900a67-be79-4040-8e97-c972007eabe7 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:20 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62900a67-be79-4040-8e97-c972007eabe7 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 Apr 29 19:17:20 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:20 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62900a67-be79-4040-8e97-c972007eabe7 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723" returned: 0 in 0.664s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:20 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 is being set with open permissions: ugo+rw Apr 29 19:17:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:20 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 Apr 29 19:17:20 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:21 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723" returned: 0 in 0.585s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:21 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.info Apr 29 19:17:21 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.info" returned: 0 in 0.587s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:22 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.info is being set with open permissions: ugo+rw Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:22 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:22 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.info Apr 29 19:17:22 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:22 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.info" returned: 0 in 0.660s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] snapshot: c90fb8f2-b511-4009-bac6-be360093a723, volume: c1f0da9c-3828-4720-8f16-ea2c7e5d6a20, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d4d15-aadc-4351-b798-0bf93ac97399]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:22 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 Apr 29 19:17:22 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:23 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723" returned: 0 in 0.747s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62900a67-be79-4040-8e97-c972007eabe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69cd417-02a8-4596-a1cf-8e1097b1fea3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:23 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 Apr 29 19:17:23 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Flow 'volume_create_manager' (cd12459d-cf9d-4852-b1d8-e438d03ddb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c917d9-01e6-4b36-a8fd-0c0827ee643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c917d9-01e6-4b36-a8fd-0c0827ee643f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1058964314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21d0280-06e0-4ab9-baae-9195cc13964f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d477dc5c674467a88ba02b652da5c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:24Z,use_quota=True,user_id='0a21ba152bbf495cb57d8872b376fcb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a72000a-5372-4fc2-825c-fba0f7fcf968),volume_type_id=4a72000a-5372-4fc2-825c-fba0f7fcf968)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b194f20-f5f3-48c4-95ba-d5f52793365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b194f20-f5f3-48c4-95ba-d5f52793365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83347b0d-e432-45e3-bff0-2aaad47ae48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83347b0d-e432-45e3-bff0-2aaad47ae48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21d0280-06e0-4ab9-baae-9195cc13964f', 'volume_name': 'volume-d21d0280-06e0-4ab9-baae-9195cc13964f', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b8b6ad-1cc4-4859-9747-97f6036dd561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b8b6ad-1cc4-4859-9747-97f6036dd561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc22ec92-fa98-49d4-9d23-8a0fcfa190bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:23 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Volume d21d0280-06e0-4ab9-baae-9195cc13964f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21d0280-06e0-4ab9-baae-9195cc13964f', 'volume_size': 1} Apr 29 19:17:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:24 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7" returned: 0 in 0.747s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:24 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:17:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:24 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 Apr 29 19:17:24 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:28 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" returned: 0 in 4.610s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:28 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd2d9bf-3199-44a4-97c5-6ebca773eb64]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:29 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 Apr 29 19:17:29 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:29 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:29 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:29 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7" returned: 0 in 0.857s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:17:29 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Converted 1024.00 MB image at 222.07 MB/s Apr 29 19:17:29 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 is being set with open permissions: ugo+rw Apr 29 19:17:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:29 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 Apr 29 19:17:29 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:30 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.594s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:17:30 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" returned: 0 in 0.588s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" released by "_copy_volume_from_snapshot" :: held 7.641s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-c90fb8f2-b511-4009-bac6-be360093a723" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c90fb8f2-b511-4009-bac6-be360093a723" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Deleting offline snapshot c90fb8f2-b511-4009-bac6-be360093a723 of volume 62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] snapshot_file for this snap is: volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13dc079-8c4e-41a6-b078-6b1fa85191f9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:30 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 Apr 29 19:17:30 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:31 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723" returned: 0 in 0.685s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62900a67-be79-4040-8e97-c972007eabe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:17:31 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c3dfc2-8e50-40bb-8af6-ab7ba960d9be]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:31 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 Apr 29 19:17:31 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:31 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7" returned: 0 in 0.700s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:31 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 Apr 29 19:17:31 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:32 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723" returned: 0 in 0.659s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:32 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723 Apr 29 19:17:32 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:33 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7.c90fb8f2-b511-4009-bac6-be360093a723" returned: 0 in 0.595s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c90fb8f2-b511-4009-bac6-be360093a723" released by "_delete_snapshot" :: held 2.727s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=88,cinder:UPDATE=106,cinder:INSERT=20,cinder:DELETE=8 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=90,cinder:UPDATE=108,cinder:INSERT=25,cinder:DELETE=5 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.653s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.401s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1058964314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21d0280-06e0-4ab9-baae-9195cc13964f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d477dc5c674467a88ba02b652da5c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:24Z,use_quota=True,user_id='0a21ba152bbf495cb57d8872b376fcb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a72000a-5372-4fc2-825c-fba0f7fcf968),volume_type_id=4a72000a-5372-4fc2-825c-fba0f7fcf968)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Creating volume d21d0280-06e0-4ab9-baae-9195cc13964f {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:17:33 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0846c192-44cf-4f4a-a804-243a3fcf08e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20', 'volume_size': 1, 'source_volid': '62900a67-be79-4040-8e97-c972007eabe7', 'source_volstatus': 'available'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:33 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f 1073741824 Apr 29 19:17:33 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63621176-d525-4eb8-83dc-2971e28f08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:33 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Volume volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 (c1f0da9c-3828-4720-8f16-ea2c7e5d6a20): created successfully Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63621176-d525-4eb8-83dc-2971e28f08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:33 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (c24a25ae-e203-4513-9863-43713c030424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b79ddf7b-d501-474e-b09c-00ee16dc9f9e tempest-VolumesGetTest-1555757260 None] Created volume successfully. Apr 29 19:17:34 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f 1073741824" returned: 0 in 0.795s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:34 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f Apr 29 19:17:34 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (39282634-ba5e-4451-ba0f-424c44bc2f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12f5d12-63ec-4f9f-a62a-f3fa740d527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12f5d12-63ec-4f9f-a62a-f3fa740d527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-282912295',display_name='tempest-VolumesGetTest-Volume-1345704317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0157779-7be0-4d89-9a09-6f6e45877c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:34Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af77d808-8a4d-48ce-9114-9afdb47aa397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af77d808-8a4d-48ce-9114-9afdb47aa397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2decab55-c2f6-4c72-b5c5-95df5d8b51ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2decab55-c2f6-4c72-b5c5-95df5d8b51ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0157779-7be0-4d89-9a09-6f6e45877c98', 'volume_name': 'volume-c0157779-7be0-4d89-9a09-6f6e45877c98', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b70f454-14ef-4f81-82ca-a97d947af6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b70f454-14ef-4f81-82ca-a97d947af6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1638fea-48ec-48ab-a070-191a220dea76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:34 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Volume c0157779-7be0-4d89-9a09-6f6e45877c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0157779-7be0-4d89-9a09-6f6e45877c98', 'volume_size': 1} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:34 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f" returned: 0 in 0.602s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-282912295',display_name='tempest-VolumesGetTest-Volume-1345704317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0157779-7be0-4d89-9a09-6f6e45877c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:34Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Creating volume c0157779-7be0-4d89-9a09-6f6e45877c98 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:17:34 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc22ec92-fa98-49d4-9d23-8a0fcfa190bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21d0280-06e0-4ab9-baae-9195cc13964f', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:34 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 1073741824 Apr 29 19:17:34 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfdf1f7-6b2c-4959-b5f8-f01837cac04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:34 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Volume volume-d21d0280-06e0-4ab9-baae-9195cc13964f (d21d0280-06e0-4ab9-baae-9195cc13964f): created successfully Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfdf1f7-6b2c-4959-b5f8-f01837cac04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Flow 'volume_create_manager' (cd12459d-cf9d-4852-b1d8-e438d03ddb2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:34 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ea555151-dbeb-4586-ae3d-fc4d8b746afa tempest-VolumeTypesAccessTest-952711011 None] Created volume successfully. Apr 29 19:17:35 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 1073741824" returned: 0 in 0.758s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:35 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 Apr 29 19:17:35 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Acquiring lock "cinder-d21d0280-06e0-4ab9-baae-9195cc13964f-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Lock "cinder-d21d0280-06e0-4ab9-baae-9195cc13964f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Acquiring lock "cinder-quobyte-d21d0280-06e0-4ab9-baae-9195cc13964f" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Lock "cinder-quobyte-d21d0280-06e0-4ab9-baae-9195cc13964f" acquired by "delete_volume" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:35 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[619df605-5378-430b-a232-957d69c3f729]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:35 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f Apr 29 19:17:35 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:36 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98" returned: 0 in 0.599s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1638fea-48ec-48ab-a070-191a220dea76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0157779-7be0-4d89-9a09-6f6e45877c98', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0118ae-fdd0-4749-8f90-6e0310262e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:36 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Volume volume-c0157779-7be0-4d89-9a09-6f6e45877c98 (c0157779-7be0-4d89-9a09-6f6e45877c98): created successfully Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0118ae-fdd0-4749-8f90-6e0310262e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (39282634-ba5e-4451-ba0f-424c44bc2f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-bbecf97f-f02f-4af8-aa06-b79488919d00 tempest-VolumesGetTest-1555757260 None] Created volume successfully. Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-c0157779-7be0-4d89-9a09-6f6e45877c98-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Lock "cinder-c0157779-7be0-4d89-9a09-6f6e45877c98-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:36 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-c0157779-7be0-4d89-9a09-6f6e45877c98" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f" returned: 0 in 0.718s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c0157779-7be0-4d89-9a09-6f6e45877c98" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:36 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f Apr 29 19:17:36 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2c126a-0e17-4b8d-a202-a45567d392ec]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:36 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 Apr 29 19:17:36 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:37 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d21d0280-06e0-4ab9-baae-9195cc13964f" returned: 0 in 0.627s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Lock "cinder-quobyte-d21d0280-06e0-4ab9-baae-9195cc13964f" released by "delete_volume" :: held 1.391s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:37 devstack cinder-volume[84523]: WARNING cinder.quota [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-792705090 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-792705090, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:17:37 devstack cinder-volume[84523]: WARNING cinder.quota [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-792705090 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-792705090, it is now deprecated. Please use the default quota class for default quota. Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Created reservations ['0c30ab73-0fa1-45b9-a415-8b090cfc9eef', 'd2f0c42b-059a-4229-9118-a9d9cfd5e34f', 'db650f7e-6ba6-419f-916c-c71d18565da5', '3fc2540d-44e8-478b-8f86-783c308b673e'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:37 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98" returned: 0 in 0.724s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:37 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:37 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:37 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98 Apr 29 19:17:37 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:37 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:37 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.603s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c0157779-7be0-4d89-9a09-6f6e45877c98" returned: 0 in 0.589s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:37 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Deleted volume successfully. Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c0157779-7be0-4d89-9a09-6f6e45877c98" released by "delete_volume" :: held 1.373s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-363a9da9-83ca-4ea4-a5cc-eb376fc8a37b tempest-VolumeTypesAccessTest-952711011 None] Lock "cinder-d21d0280-06e0-4ab9-baae-9195cc13964f-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Created reservations ['041f5bd4-11ec-43d0-aa63-91abf83fd452', '1d55c1d9-55ad-421d-8534-47ef6fe2bf3f', '2e8a3072-04d8-417d-9aea-bccff27624a8', '57212e7e-037b-4896-8034-4856b4caca68'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:38 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:38 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:38 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.610s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Deleted volume successfully. Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2c392734-a539-49f4-be23-7710b16d5552 tempest-VolumesGetTest-1555757260 None] Lock "cinder-c0157779-7be0-4d89-9a09-6f6e45877c98-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Lock "cinder-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c924b-ba63-46b8-8734-768781bf7484]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:38 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 Apr 29 19:17:38 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:39 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" returned: 0 in 0.719s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:39 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20 Apr 29 19:17:39 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:40 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" returned: 0 in 0.610s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20" released by "delete_volume" :: held 1.369s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Created reservations ['9de8d0e1-b40c-4e3c-8e20-fb2b460fe271', '6deb1f89-3ebd-4a82-bacf-e359ec943f81', 'b3e727d4-9eae-4398-954a-e1fc54ce5cb2', '5752b616-b020-46ad-bfa5-f3d100c4c9d7'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:40 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:40 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:40 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.647s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Deleted volume successfully. Apr 29 19:17:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-681d5eac-30d2-4433-9a06-c5ac5a5139af tempest-VolumesGetTest-1555757260 None] Lock "cinder-c1f0da9c-3828-4720-8f16-ea2c7e5d6a20-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-62900a67-be79-4040-8e97-c972007eabe7-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Lock "cinder-62900a67-be79-4040-8e97-c972007eabe7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-62900a67-be79-4040-8e97-c972007eabe7" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-62900a67-be79-4040-8e97-c972007eabe7" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:41 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee693afb-6412-4a7c-be69-f9d009ef3d2d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:41 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 Apr 29 19:17:41 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:41 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7" returned: 0 in 0.780s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:41 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7 Apr 29 19:17:41 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:42 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-62900a67-be79-4040-8e97-c972007eabe7" returned: 0 in 0.609s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-62900a67-be79-4040-8e97-c972007eabe7" released by "delete_volume" :: held 1.461s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Created reservations ['2bc29b95-82c6-44c2-a80a-bc3d6be9db70', 'e45ce299-8a33-45ff-9691-7fb755ebceaa', '60b861a9-6939-437f-b9be-4223b204cc9b', 'b436f71f-cb0b-42f7-a876-04cd5563b994'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:42 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:42 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:43 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.607s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:43 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Deleted volume successfully. Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4e6a73c7-e093-462d-bbba-7daa465b08c1 tempest-VolumesGetTest-1555757260 None] Lock "cinder-62900a67-be79-4040-8e97-c972007eabe7-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (65bec2a9-1e13-4d30-b851-ab576ae4fe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddfa6fb-fa54-4cf5-a273-250b060699e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddfa6fb-fa54-4cf5-a273-250b060699e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2001309304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4d9c00-bc88-47a4-8d83-8a3788247b4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:44Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bdec7e-80d8-4420-9253-a9da59d39444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28bdec7e-80d8-4420-9253-a9da59d39444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb2530c-111a-4db5-9eba-f8a7a6d2d466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:43 devstack cinder-volume[84523]: DEBUG cinder.image.glance [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Creating Keystone auth plugin from conf {{(pid=84523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 19:17:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb2530c-111a-4db5-9eba-f8a7a6d2d466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a4d9c00-bc88-47a4-8d83-8a3788247b4e', 'volume_name': 'volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87ea8b9-172d-4e79-b121-8e8fc70054b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87ea8b9-172d-4e79-b121-8e8fc70054b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7163af94-1d5d-45df-96d0-e2280b9e38fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:44 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Volume 4a4d9c00-bc88-47a4-8d83-8a3788247b4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 19:17:44 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Trying to clone 4a4d9c00-bc88-47a4-8d83-8a3788247b4e from image f7bc816f-25b0-408e-baa1-85adebe218d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]). {{(pid=84523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 19:17:44 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 19:17:44 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Image download 20.69 MB at 20.69 MB/s Apr 29 19:17:44 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[29289550-7aeb-4ad7-85b7-b61effa40f91]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:44 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD Apr 29 19:17:44 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:45 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD" returned: 0 in 0.716s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:45 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Temporary image f7bc816f-25b0-408e-baa1-85adebe218d0 is fetched for user fd8d6fdab77d4f23ab435bf3996b912e. {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 19:17:45 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4993836d-d19a-4d8e-9b90-233b3abcb178]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:45 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD Apr 29 19:17:45 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:46 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD" returned: 0 in 0.716s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2001309304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4d9c00-bc88-47a4-8d83-8a3788247b4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:44Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Creating volume 4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:17:46 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:17:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:46 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e 1073741824 Apr 29 19:17:46 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:47 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e 1073741824" returned: 0 in 0.863s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:47 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e Apr 29 19:17:47 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:47 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" returned: 0 in 0.609s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:17:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:47 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Attempting download of f7bc816f-25b0-408e-baa1-85adebe218d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}])) to volume 4a4d9c00-bc88-47a4-8d83-8a3788247b4e. {{(pid=84523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 29 19:17:47 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e8dadb-3944-40ee-a2a1-fc15b504e68a]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_22clcces {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:47 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_22clcces Apr 29 19:17:47 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:48 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_22clcces" returned: 0 in 0.704s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_22clcces {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:48 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_22clcces Apr 29 19:17:48 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:49 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_22clcces" returned: 1 in 0.728s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_22clcces' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:17:49 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[82faf3fc-4835-41dd-9561-e7ca68e7975a]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:49 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD Apr 29 19:17:49 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:50 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD" returned: 0 in 0.716s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:50 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] f7bc816f-25b0-408e-baa1-85adebe218d0 was qcow2, converting to raw {{(pid=84523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 19:17:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:50 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e Apr 29 19:17:50 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:52 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" returned: 0 in 1.984s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:52 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_my9ltkj1devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:17:52 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Converted 112.00 MB image at 56.39 MB/s Apr 29 19:17:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:52 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e 1G Apr 29 19:17:52 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:52 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e 1G" returned: 0 in 0.678s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2177111-b8b6-4f30-9063-b52e5871f786]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:52 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e Apr 29 19:17:52 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:53 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" returned: 0 in 0.706s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:53 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e Apr 29 19:17:53 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:54 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" returned: 1 in 0.715s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Downloaded image f7bc816f-25b0-408e-baa1-85adebe218d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}])) to volume 4a4d9c00-bc88-47a4-8d83-8a3788247b4e successfully. {{(pid=84523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Temporary image f7bc816f-25b0-408e-baa1-85adebe218d0 for user fd8d6fdab77d4f23ab435bf3996b912e is deleted. {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Marking volume 4a4d9c00-bc88-47a4-8d83-8a3788247b4e as bootable. {{(pid=84523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Copying metadata from image f7bc816f-25b0-408e-baa1-85adebe218d0 to 4a4d9c00-bc88-47a4-8d83-8a3788247b4e. {{(pid=84523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Creating volume glance metadata for volume 4a4d9c00-bc88-47a4-8d83-8a3788247b4e backed by image f7bc816f-25b0-408e-baa1-85adebe218d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7163af94-1d5d-45df-96d0-e2280b9e38fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d547bc-01d1-4eb0-88c2-83c53c1f34c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:54 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Volume volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e (4a4d9c00-bc88-47a4-8d83-8a3788247b4e): created successfully Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d547bc-01d1-4eb0-88c2-83c53c1f34c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (65bec2a9-1e13-4d30-b851-ab576ae4fe97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b771e244-71ed-4678-97c2-9c771bba2bc0 tempest-VolumesGetTest-1555757260 None] Created volume successfully. Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (1b15fdf8-6164-40ab-b441-ffea4b24b486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fc219e-2fde-4bd4-a4a4-141e52984b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fc219e-2fde-4bd4-a4a4-141e52984b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2039802115',display_name='tempest-VolumesGetTest-Volume-2033101047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c065297a-e56d-4654-a494-27abad09d588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:55Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e2f2f4-3a56-4f34-9ce9-d2717be17614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e2f2f4-3a56-4f34-9ce9-d2717be17614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899dd8f2-ada5-464b-8d36-dea457f39c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899dd8f2-ada5-464b-8d36-dea457f39c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c065297a-e56d-4654-a494-27abad09d588', 'volume_name': 'volume-c065297a-e56d-4654-a494-27abad09d588', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8ea552-c227-45c9-a796-ddd9d08d0f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8ea552-c227-45c9-a796-ddd9d08d0f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67640d58-310f-4f70-b273-7ab9b8c54025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:55 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Volume c065297a-e56d-4654-a494-27abad09d588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c065297a-e56d-4654-a494-27abad09d588', 'volume_size': 1} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:17:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2039802115',display_name='tempest-VolumesGetTest-Volume-2033101047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c065297a-e56d-4654-a494-27abad09d588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13319dfa4a704559a6c1e10a9db259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:17:55Z,use_quota=True,user_id='fd8d6fdab77d4f23ab435bf3996b912e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Creating volume c065297a-e56d-4654-a494-27abad09d588 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:17:55 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:17:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:55 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 1073741824 Apr 29 19:17:55 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:56 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 1073741824" returned: 0 in 0.799s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:56 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 Apr 29 19:17:56 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:56 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588" returned: 0 in 0.622s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67640d58-310f-4f70-b273-7ab9b8c54025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c065297a-e56d-4654-a494-27abad09d588', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c923300c-dd90-4df2-a42c-b68441fdebef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:17:56 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Volume volume-c065297a-e56d-4654-a494-27abad09d588 (c065297a-e56d-4654-a494-27abad09d588): created successfully Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c923300c-dd90-4df2-a42c-b68441fdebef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:17:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Flow 'volume_create_manager' (1b15fdf8-6164-40ab-b441-ffea4b24b486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:17:56 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3be60839-ba0f-48ac-86d3-16e53f58e600 tempest-VolumesGetTest-1555757260 None] Created volume successfully. Apr 29 19:17:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-c065297a-e56d-4654-a494-27abad09d588-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Lock "cinder-c065297a-e56d-4654-a494-27abad09d588-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-c065297a-e56d-4654-a494-27abad09d588" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c065297a-e56d-4654-a494-27abad09d588" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:57 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6400ae65-6d52-4bfb-8403-973322785d77]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:17:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:57 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 Apr 29 19:17:57 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:58 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588" returned: 0 in 0.761s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:58 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588 Apr 29 19:17:58 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:59 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-c065297a-e56d-4654-a494-27abad09d588" returned: 0 in 0.614s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-c065297a-e56d-4654-a494-27abad09d588" released by "delete_volume" :: held 1.475s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Created reservations ['85a32edd-a3a7-4d68-8236-dfcc06a1b48e', 'c636dc0c-511a-48fb-bf70-da2e800c59b0', 'c3dd56d5-1ab0-45e6-a3bc-6d9a55179701', 'c29ffae4-093c-44b4-bcee-ea987bfc1211'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:17:59 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:17:59 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:17:59 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.621s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:17:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Deleted volume successfully. Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cc592492-0db9-45e4-9c32-9c30ccd3f8da tempest-VolumesGetTest-1555757260 None] Lock "cinder-c065297a-e56d-4654-a494-27abad09d588-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-4a4d9c00-bc88-47a4-8d83-8a3788247b4e-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Lock "cinder-4a4d9c00-bc88-47a4-8d83-8a3788247b4e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Acquiring lock "cinder-quobyte-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:17:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" acquired by "delete_volume" :: waited 0.013s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a91427b-4188-44e3-a1dc-f597bb391610]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:00 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e Apr 29 19:18:00 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:00 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" returned: 0 in 0.726s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:00 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e Apr 29 19:18:00 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:01 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" returned: 1 in 0.741s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:18:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:01 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e Apr 29 19:18:01 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:02 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" returned: 0 in 0.638s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Lock "cinder-quobyte-4a4d9c00-bc88-47a4-8d83-8a3788247b4e" released by "delete_volume" :: held 2.187s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Created reservations ['3b49335e-bb5c-48bb-a477-e0da63f506e5', '12c9db29-2ff5-45b7-9fe1-bba66654a07d', '0df643b5-3c17-4e1d-8521-61ba1a943fe7', 'f6ae71bc-8780-4f7b-bba4-1e3eb80b6d0d'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:02 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:18:02 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:02 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.588s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:18:02 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Deleted volume successfully. Apr 29 19:18:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b4249862-1527-4d63-a99a-effaaa84cf15 tempest-VolumesGetTest-1555757260 None] Lock "cinder-4a4d9c00-bc88-47a4-8d83-8a3788247b4e-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Flow 'volume_create_manager' (82b57638-813f-4124-89f6-d2030e7b9355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60f1e8e-d768-4b4f-a0df-51455c2c7aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60f1e8e-d768-4b4f-a0df-51455c2c7aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1326309572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c76644-c775-448f-b6a7-fde5fce7d308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b2692aa0284b3292fa65fb9d1c81c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:06Z,use_quota=True,user_id='f88fa77c963541af8c04a0a483b72ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7284318a-365a-4daa-9a5d-28764599a678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7284318a-365a-4daa-9a5d-28764599a678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefc7648-acd2-4d69-ba08-15605a01f771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefc7648-acd2-4d69-ba08-15605a01f771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c76644-c775-448f-b6a7-fde5fce7d308', 'volume_name': 'volume-81c76644-c775-448f-b6a7-fde5fce7d308', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdcd8a5-483b-4b4b-bda2-51dbc9f3bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdcd8a5-483b-4b4b-bda2-51dbc9f3bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb905bc7-7184-456d-9bdf-2fc1bdabc64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:05 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Volume 81c76644-c775-448f-b6a7-fde5fce7d308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c76644-c775-448f-b6a7-fde5fce7d308', 'volume_size': 1} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1326309572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c76644-c775-448f-b6a7-fde5fce7d308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b2692aa0284b3292fa65fb9d1c81c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:06Z,use_quota=True,user_id='f88fa77c963541af8c04a0a483b72ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:18:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Creating volume 81c76644-c775-448f-b6a7-fde5fce7d308 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:18:06 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:06 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 1073741824 Apr 29 19:18:06 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:06 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 1073741824" returned: 0 in 0.761s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:06 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 Apr 29 19:18:06 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:07 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308" returned: 0 in 0.602s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:18:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb905bc7-7184-456d-9bdf-2fc1bdabc64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c76644-c775-448f-b6a7-fde5fce7d308', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e0a248-1d6d-46d9-954b-c354beedb181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:07 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Volume volume-81c76644-c775-448f-b6a7-fde5fce7d308 (81c76644-c775-448f-b6a7-fde5fce7d308): created successfully Apr 29 19:18:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e0a248-1d6d-46d9-954b-c354beedb181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Flow 'volume_create_manager' (82b57638-813f-4124-89f6-d2030e7b9355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-73f4fd67-1867-4b94-bf45-b74704c1834d tempest-VolumesNegativeTest-705532029 None] Created volume successfully. Apr 29 19:18:17 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=66,cinder:SELECT=47,cinder:INSERT=19,cinder:DELETE=6 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:18:17 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=48,cinder:UPDATE=66,cinder:INSERT=24,cinder:DELETE=6 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (c03d807a-cd0a-498a-b9c5-836fd0b8c935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a25ea1-ba25-4047-9451-59ebe435febf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a25ea1-ba25-4047-9451-59ebe435febf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252658490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0de5127-4ba6-4ede-a84a-c570a1656e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:29Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdf0048-f8e1-4bbe-a3d9-4966c3021df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdf0048-f8e1-4bbe-a3d9-4966c3021df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701f4003-3e77-4ac8-aa67-85c5fefbe914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701f4003-3e77-4ac8-aa67-85c5fefbe914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0de5127-4ba6-4ede-a84a-c570a1656e39', 'volume_name': 'volume-f0de5127-4ba6-4ede-a84a-c570a1656e39', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649f1b0f-b793-4c55-85d6-39a3dba215c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649f1b0f-b793-4c55-85d6-39a3dba215c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c36862-1481-4874-8256-ae972216945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:28 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Volume f0de5127-4ba6-4ede-a84a-c570a1656e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0de5127-4ba6-4ede-a84a-c570a1656e39', 'volume_size': 1} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252658490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0de5127-4ba6-4ede-a84a-c570a1656e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:29Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Creating volume f0de5127-4ba6-4ede-a84a-c570a1656e39 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:18:28 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:18:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:28 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 1073741824 Apr 29 19:18:28 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:29 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 1073741824" returned: 0 in 0.811s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:29 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 Apr 29 19:18:29 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:29 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:18:29 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39" returned: 0 in 0.619s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:18:30 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c36862-1481-4874-8256-ae972216945e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0de5127-4ba6-4ede-a84a-c570a1656e39', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755ba6cf-738c-47c6-a319-5e8a48bc675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:30 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Volume volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 (f0de5127-4ba6-4ede-a84a-c570a1656e39): created successfully Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755ba6cf-738c-47c6-a319-5e8a48bc675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (c03d807a-cd0a-498a-b9c5-836fd0b8c935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:30 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.655s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:18:30 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-28c3e556-fe55-452a-8d0e-2116e1567c1c tempest-VolumesActionsTest-899685905 None] Created volume successfully. Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4562e7de-8e71-4b73-a896-5baaee3a7a39 tempest-VolumesActionsTest-899685905 None] Acquiring lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39" by "attach_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4562e7de-8e71-4b73-a896-5baaee3a7a39 tempest-VolumesActionsTest-899685905 None] Lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39" acquired by "attach_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:30 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4562e7de-8e71-4b73-a896-5baaee3a7a39 tempest-VolumesActionsTest-899685905 None] Attaching volume f0de5127-4ba6-4ede-a84a-c570a1656e39 to instance 6931018e-9da1-4f11-b480-5539d5b0b3cd at mountpoint /dev/vdb on host None. Apr 29 19:18:30 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4562e7de-8e71-4b73-a896-5baaee3a7a39 tempest-VolumesActionsTest-899685905 None] Attach volume completed successfully. Apr 29 19:18:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4562e7de-8e71-4b73-a896-5baaee3a7a39 tempest-VolumesActionsTest-899685905 None] Lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39" released by "attach_volume" :: held 0.087s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:31 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-25c0b6aa-9e59-4e02-b3d3-4e3cae4eaf9a tempest-VolumesActionsTest-788449285 None] Terminate volume connection completed successfully. Apr 29 19:18:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-25c0b6aa-9e59-4e02-b3d3-4e3cae4eaf9a tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-detach_volume" by "detach_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-25c0b6aa-9e59-4e02-b3d3-4e3cae4eaf9a tempest-VolumesActionsTest-788449285 None] Lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:32 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-25c0b6aa-9e59-4e02-b3d3-4e3cae4eaf9a tempest-VolumesActionsTest-788449285 None] Detaching volume f0de5127-4ba6-4ede-a84a-c570a1656e39 from instance 6931018e-9da1-4f11-b480-5539d5b0b3cd. Apr 29 19:18:32 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-25c0b6aa-9e59-4e02-b3d3-4e3cae4eaf9a tempest-VolumesActionsTest-788449285 None] Detach volume completed successfully. Apr 29 19:18:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-25c0b6aa-9e59-4e02-b3d3-4e3cae4eaf9a tempest-VolumesActionsTest-788449285 None] Lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dde3116a-9b0c-4ddb-9b94-604a5cf8c568 tempest-VolumesActionsTest-899685905 None] Acquiring lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-detach_volume" by "detach_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dde3116a-9b0c-4ddb-9b94-604a5cf8c568 tempest-VolumesActionsTest-899685905 None] Lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-dde3116a-9b0c-4ddb-9b94-604a5cf8c568 tempest-VolumesActionsTest-899685905 None] Volume detach called, but volume not attached. Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-dde3116a-9b0c-4ddb-9b94-604a5cf8c568 tempest-VolumesActionsTest-899685905 None] Lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Acquiring lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Acquiring lock "cinder-quobyte-f0de5127-4ba6-4ede-a84a-c570a1656e39" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Lock "cinder-quobyte-f0de5127-4ba6-4ede-a84a-c570a1656e39" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68339f1-581b-4bd9-a9df-474d9bce9227]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:33 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 Apr 29 19:18:33 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:34 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39" returned: 0 in 0.773s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:34 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39 Apr 29 19:18:34 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:35 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f0de5127-4ba6-4ede-a84a-c570a1656e39" returned: 0 in 0.639s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Lock "cinder-quobyte-f0de5127-4ba6-4ede-a84a-c570a1656e39" released by "delete_volume" :: held 1.475s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Created reservations ['cb4f8801-1c6b-4264-b250-d0b616e3a5ea', 'f07709b7-4854-40c3-85e6-fad6c995591b', 'a00ecfd0-8c77-425e-8705-c6dfd582ef7c', '93c7b348-a9bb-4396-a6ed-f2f58768d0db'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:35 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:18:35 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:36 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.639s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:36 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:18:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Deleted volume successfully. Apr 29 19:18:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19e37602-f77c-47c6-8de3-bc51a87b6eb9 tempest-VolumesActionsTest-899685905 None] Lock "cinder-f0de5127-4ba6-4ede-a84a-c570a1656e39-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Acquiring lock "cinder-81c76644-c775-448f-b6a7-fde5fce7d308-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Lock "cinder-81c76644-c775-448f-b6a7-fde5fce7d308-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Acquiring lock "cinder-quobyte-81c76644-c775-448f-b6a7-fde5fce7d308" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Lock "cinder-quobyte-81c76644-c775-448f-b6a7-fde5fce7d308" acquired by "delete_volume" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:38 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5782bb14-b07d-49cc-a921-506ca61c25ef]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:38 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 Apr 29 19:18:38 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:39 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308" returned: 0 in 0.783s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:39 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308 Apr 29 19:18:39 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:40 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-81c76644-c775-448f-b6a7-fde5fce7d308" returned: 0 in 0.617s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Lock "cinder-quobyte-81c76644-c775-448f-b6a7-fde5fce7d308" released by "delete_volume" :: held 1.445s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Created reservations ['11b4f9dc-c61d-4e4c-af59-990c885b110a', 'b081599d-e436-446f-88c7-b4897ed7e4b0', 'a9e2d94d-cbd4-4cd0-9e2e-87047dc02724', 'fc24a866-ba6f-43f9-9725-b9418663c8dc'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:40 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:18:40 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:40 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.584s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:18:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Deleted volume successfully. Apr 29 19:18:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8348179-f6d2-4777-9105-0c7eb6c041e4 tempest-VolumesNegativeTest-705532029 None] Lock "cinder-81c76644-c775-448f-b6a7-fde5fce7d308-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (36ef6be9-1542-442d-abdd-df42ac9c1a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ce31fc-1eef-40ea-9966-f4186660da07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ce31fc-1eef-40ea-9966-f4186660da07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2021423705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a913cf-4c45-4763-9fcf-61b22d71fcaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:43Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de68e96-fce8-4968-a78f-dd5b15a7671f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de68e96-fce8-4968-a78f-dd5b15a7671f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcbaf49-6815-4e9b-8b3a-b40e9af9ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcbaf49-6815-4e9b-8b3a-b40e9af9ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a913cf-4c45-4763-9fcf-61b22d71fcaf', 'volume_name': 'volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81125f0b-510b-45bc-afd5-1ecaaea2513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81125f0b-510b-45bc-afd5-1ecaaea2513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06da4302-9af5-42d4-bd3a-41e51c7296fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:42 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Volume f2a913cf-4c45-4763-9fcf-61b22d71fcaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf', 'volume_size': 1} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2021423705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a913cf-4c45-4763-9fcf-61b22d71fcaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:43Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Creating volume f2a913cf-4c45-4763-9fcf-61b22d71fcaf {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:18:42 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:18:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:43 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf 1073741824 Apr 29 19:18:43 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Flow 'volume_create_manager' (a7ff2c9c-57a1-475a-ab6d-28f3fe611a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d90ad8-968c-401f-bb02-582dc9217cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d90ad8-968c-401f-bb02-582dc9217cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1025415868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc62310b-8336-4b45-94c4-b77ed566241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60126a349f9648989539d21528bfaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:43Z,use_quota=True,user_id='bc51dae4a4f24fb0bd889add43e9e27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960ad60c-a6bb-47b2-8945-88eeb48e1045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960ad60c-a6bb-47b2-8945-88eeb48e1045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caa69c9-2512-4a0f-b059-46c9858a6d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caa69c9-2512-4a0f-b059-46c9858a6d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc62310b-8336-4b45-94c4-b77ed566241a', 'volume_name': 'volume-dc62310b-8336-4b45-94c4-b77ed566241a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb17a4-b934-4a57-8fd9-dd5b8f165f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb17a4-b934-4a57-8fd9-dd5b8f165f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ee93cb-33c7-425a-acca-9a3d493f9e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:43 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Volume dc62310b-8336-4b45-94c4-b77ed566241a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc62310b-8336-4b45-94c4-b77ed566241a', 'volume_size': 1} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:43 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf 1073741824" returned: 0 in 0.778s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:43 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf Apr 29 19:18:43 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:44 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf" returned: 0 in 0.605s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1025415868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc62310b-8336-4b45-94c4-b77ed566241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60126a349f9648989539d21528bfaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:43Z,use_quota=True,user_id='bc51dae4a4f24fb0bd889add43e9e27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Creating volume dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:18:44 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06da4302-9af5-42d4-bd3a-41e51c7296fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:44 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a 1073741824 Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d027b84-e2f6-48ca-afe1-3c129abfd51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:44 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:44 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Volume volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf (f2a913cf-4c45-4763-9fcf-61b22d71fcaf): created successfully Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d027b84-e2f6-48ca-afe1-3c129abfd51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (36ef6be9-1542-442d-abdd-df42ac9c1a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:44 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-99908f76-f72c-488d-89da-ed3be9045b6c tempest-VolumesActionsTest-899685905 None] Created volume successfully. Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-f2a913cf-4c45-4763-9fcf-61b22d71fcaf-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Lock "cinder-f2a913cf-4c45-4763-9fcf-61b22d71fcaf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:45 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a 1073741824" returned: 0 in 0.782s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-quobyte-f2a913cf-4c45-4763-9fcf-61b22d71fcaf" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Lock "cinder-quobyte-f2a913cf-4c45-4763-9fcf-61b22d71fcaf" acquired by "delete_volume" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:45 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a Apr 29 19:18:45 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[499a529e-269f-4e08-a976-59a6b8a3e0e8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:45 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf Apr 29 19:18:45 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:45 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a" returned: 0 in 0.588s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ee93cb-33c7-425a-acca-9a3d493f9e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc62310b-8336-4b45-94c4-b77ed566241a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdca8f2-6890-40ed-adb1-347df243763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Volume volume-dc62310b-8336-4b45-94c4-b77ed566241a (dc62310b-8336-4b45-94c4-b77ed566241a): created successfully Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdca8f2-6890-40ed-adb1-347df243763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Flow 'volume_create_manager' (a7ff2c9c-57a1-475a-ab6d-28f3fe611a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3469dd05-c463-4aef-be42-4dc4d48a134d tempest-VolumeDependencyTests-554922787 None] Created volume successfully. Apr 29 19:18:46 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf" returned: 0 in 0.728s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:46 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf Apr 29 19:18:46 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Creating offline snapshot 33ea0c05-21f7-4393-9cb9-fad16d5f4407 of volume dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8603c01-ba93-4744-9f3f-f9802012c02d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:46 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f2a913cf-4c45-4763-9fcf-61b22d71fcaf" returned: 0 in 0.614s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Lock "cinder-quobyte-f2a913cf-4c45-4763-9fcf-61b22d71fcaf" released by "delete_volume" :: held 1.385s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:46 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a Apr 29 19:18:46 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Created reservations ['97d50545-b367-41ad-b652-9e0d44f82d09', 'd6f7ea0f-c07e-48b6-b0ae-2de614fdab11', 'e63be7f9-b423-4bcc-a499-c0d5e5833d95', 'a5d97076-2b7b-4472-93ab-4e6987b63622'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:46 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:18:46 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:47 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a" returned: 0 in 0.717s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:47 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 1G Apr 29 19:18:47 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:47 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.619s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:18:47 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Deleted volume successfully. Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e1c76ca4-8772-4939-822c-15e4fa3efb95 tempest-VolumesActionsTest-788449285 None] Lock "cinder-f2a913cf-4c45-4763-9fcf-61b22d71fcaf-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (3e2da0a2-4543-4ab5-b043-3c3d905b6466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4fae4b-e57f-4216-947b-4171a25eafd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4fae4b-e57f-4216-947b-4171a25eafd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-867872312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ae2527-4575-427f-b0ad-5b6946ea3299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:48Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f9139d-9a61-4159-a66a-cb2f4d627df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f9139d-9a61-4159-a66a-cb2f4d627df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075c4dca-9aa8-4db1-a214-be37974cabe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075c4dca-9aa8-4db1-a214-be37974cabe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ae2527-4575-427f-b0ad-5b6946ea3299', 'volume_name': 'volume-b6ae2527-4575-427f-b0ad-5b6946ea3299', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c720e28-fcbf-4444-8366-762bc824762d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c720e28-fcbf-4444-8366-762bc824762d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd6c965-7713-4af0-81d4-805bc128d285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:47 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Volume b6ae2527-4575-427f-b0ad-5b6946ea3299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ae2527-4575-427f-b0ad-5b6946ea3299', 'volume_size': 1} Apr 29 19:18:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:48 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 1G" returned: 0 in 0.782s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc62310b-8336-4b45-94c4-b77ed566241a -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:48 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc62310b-8336-4b45-94c4-b77ed566241a -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 Apr 29 19:18:48 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:48 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc62310b-8336-4b45-94c4-b77ed566241a -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407" returned: 0 in 0.629s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:48 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 is being set with open permissions: ugo+rw Apr 29 19:18:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:48 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 Apr 29 19:18:48 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:49 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407" returned: 0 in 0.600s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:49 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.info Apr 29 19:18:49 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:49 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.info" returned: 0 in 0.582s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:49 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.info is being set with open permissions: ugo+rw Apr 29 19:18:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:49 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.info Apr 29 19:18:49 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:50 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.info" returned: 0 in 0.578s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.971s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.570s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-867872312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ae2527-4575-427f-b0ad-5b6946ea3299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:48Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Creating volume b6ae2527-4575-427f-b0ad-5b6946ea3299 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:18:50 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:18:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:50 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 1073741824 Apr 29 19:18:50 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:50 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-53454264-da8c-4a72-8637-b2ca0dda23a4 tempest-VolumeDependencyTests-554922787 None] Create snapshot completed successfully Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Flow 'volume_create_manager' (0f3e5e7f-eaf0-4c6d-8b2b-5da4748e0847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8cbdb2-ac47-47d9-93ff-c248c737319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8cbdb2-ac47-47d9-93ff-c248c737319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1370764245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c413731-2d18-47ae-b3e5-8448db55fd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60126a349f9648989539d21528bfaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33ea0c05-21f7-4393-9cb9-fad16d5f4407,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:51Z,use_quota=True,user_id='bc51dae4a4f24fb0bd889add43e9e27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26ffcc9-81bc-42cb-9592-238297bf50fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26ffcc9-81bc-42cb-9592-238297bf50fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7626304-1740-4cb5-8d98-776041a9cc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7626304-1740-4cb5-8d98-776041a9cc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c413731-2d18-47ae-b3e5-8448db55fd10', 'volume_name': 'volume-0c413731-2d18-47ae-b3e5-8448db55fd10', 'volume_size': 1, 'snapshot_id': '33ea0c05-21f7-4393-9cb9-fad16d5f4407'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e92a40-7e2c-4d0c-9b1c-3e63138a0d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e92a40-7e2c-4d0c-9b1c-3e63138a0d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfde7dd-e030-4c5b-9f91-e94f479354ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Volume 0c413731-2d18-47ae-b3e5-8448db55fd10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c413731-2d18-47ae-b3e5-8448db55fd10', 'volume_size': 1, 'snapshot_id': '33ea0c05-21f7-4393-9cb9-fad16d5f4407'} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:51 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 1073741824" returned: 0 in 0.793s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:51 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 Apr 29 19:18:51 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:51 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299" returned: 0 in 0.575s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.649s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-33ea0c05-21f7-4393-9cb9-fad16d5f4407-0c413731-2d18-47ae-b3e5-8448db55fd10" by "_create_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd6c965-7713-4af0-81d4-805bc128d285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ae2527-4575-427f-b0ad-5b6946ea3299', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ef69b0-44e3-46d0-a596-1c31b10ff518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-33ea0c05-21f7-4393-9cb9-fad16d5f4407-0c413731-2d18-47ae-b3e5-8448db55fd10" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Creating volume 0c413731-2d18-47ae-b3e5-8448db55fd10 from snapshot 33ea0c05-21f7-4393-9cb9-fad16d5f4407 {{(pid=84523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-0c413731-2d18-47ae-b3e5-8448db55fd10" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Volume volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 (b6ae2527-4575-427f-b0ad-5b6946ea3299): created successfully Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ef69b0-44e3-46d0-a596-1c31b10ff518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (3e2da0a2-4543-4ab5-b043-3c3d905b6466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-0c413731-2d18-47ae-b3e5-8448db55fd10" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] snapshot: 33ea0c05-21f7-4393-9cb9-fad16d5f4407, volume: 0c413731-2d18-47ae-b3e5-8448db55fd10, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:52 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-39a3cfce-acb4-4961-be05-812ab12d8673 tempest-VolumesActionsTest-899685905 None] Created volume successfully. Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[57764fd7-0969-4c29-aa95-3e7ddd23659d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:52 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 Apr 29 19:18:52 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-b6ae2527-4575-427f-b0ad-5b6946ea3299-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Lock "cinder-b6ae2527-4575-427f-b0ad-5b6946ea3299-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-quobyte-b6ae2527-4575-427f-b0ad-5b6946ea3299" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Lock "cinder-quobyte-b6ae2527-4575-427f-b0ad-5b6946ea3299" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f20a132-d287-43d6-87fd-bd3687e528fe]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:52 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 Apr 29 19:18:52 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:52 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407" returned: 0 in 0.773s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc62310b-8336-4b45-94c4-b77ed566241a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaef3b7c-db54-4239-91de-cc48b3670696]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:52 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a Apr 29 19:18:52 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:53 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299" returned: 0 in 0.725s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:53 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299 Apr 29 19:18:53 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:53 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a" returned: 0 in 0.712s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:53 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 Apr 29 19:18:53 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:53 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b6ae2527-4575-427f-b0ad-5b6946ea3299" returned: 0 in 0.592s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Lock "cinder-quobyte-b6ae2527-4575-427f-b0ad-5b6946ea3299" released by "delete_volume" :: held 1.367s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Created reservations ['90565c92-1819-4891-a5c4-8f89ade55301', '2204b636-3fcd-4699-b8d5-a249b02df0a9', 'b5c43595-292c-4f63-95dd-3f7dca2c7818', '037d755e-c749-4b66-a267-91a0437e8bb6'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:53 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:18:53 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:54 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.179s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:54 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:18:54 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Deleted volume successfully. Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7235ede4-4a81-4c24-91f6-18983ce820f7 tempest-VolumesActionsTest-788449285 None] Lock "cinder-b6ae2527-4575-427f-b0ad-5b6946ea3299-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (8cbd6bd3-331c-40ce-9d53-bc740bac0485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75760e9b-8fa1-42d4-b25f-3f3e44c9e6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75760e9b-8fa1-42d4-b25f-3f3e44c9e6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-382099584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6890a90c-cd34-49d1-95f3-cf3f5509f2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:56Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c230db9b-3040-470e-8e80-235c7e85798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c230db9b-3040-470e-8e80-235c7e85798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de3484f-c0ea-4e05-9dcd-db1580d5a24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de3484f-c0ea-4e05-9dcd-db1580d5a24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6890a90c-cd34-49d1-95f3-cf3f5509f2fe', 'volume_name': 'volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b245bb6-d132-4ccb-b035-fe53d6a49db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b245bb6-d132-4ccb-b035-fe53d6a49db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcdf97b-bb17-472e-9355-46fdb3b218b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:55 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Volume 6890a90c-cd34-49d1-95f3-cf3f5509f2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe', 'volume_size': 1} Apr 29 19:18:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:58 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10" returned: 0 in 4.790s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:58 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded67103-2bc4-4456-b552-506b4c625333]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:18:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:58 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a Apr 29 19:18:58 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:59 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a" returned: 0 in 0.863s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:18:59 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Converted 1024.00 MB image at 213.73 MB/s Apr 29 19:18:59 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 is being set with open permissions: ugo+rw Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:59 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 Apr 29 19:18:59 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:59 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10" returned: 0 in 0.583s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-0c413731-2d18-47ae-b3e5-8448db55fd10" released by "_copy_volume_from_snapshot" :: held 7.818s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-33ea0c05-21f7-4393-9cb9-fad16d5f4407-0c413731-2d18-47ae-b3e5-8448db55fd10" released by "_create_volume_from_snapshot" :: held 7.857s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.886s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.025s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-382099584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6890a90c-cd34-49d1-95f3-cf3f5509f2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:18:56Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Creating volume 6890a90c-cd34-49d1-95f3-cf3f5509f2fe {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:18:59 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:18:59 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe 1073741824 Apr 29 19:18:59 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfde7dd-e030-4c5b-9f91-e94f479354ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c413731-2d18-47ae-b3e5-8448db55fd10', 'volume_size': 1, 'snapshot_id': '33ea0c05-21f7-4393-9cb9-fad16d5f4407'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d655ce69-f2ec-48f3-b9b3-76d04f2118bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:18:59 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Volume volume-0c413731-2d18-47ae-b3e5-8448db55fd10 (0c413731-2d18-47ae-b3e5-8448db55fd10): created successfully Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d655ce69-f2ec-48f3-b9b3-76d04f2118bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Flow 'volume_create_manager' (0f3e5e7f-eaf0-4c6d-8b2b-5da4748e0847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:18:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-568431d9-c5c2-4c8b-b776-f6d904e4012a tempest-VolumeDependencyTests-554922787 None] Created volume successfully. Apr 29 19:18:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-33ea0c05-21f7-4393-9cb9-fad16d5f4407-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-33ea0c05-21f7-4393-9cb9-fad16d5f4407-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-dc62310b-8336-4b45-94c4-b77ed566241a" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-dc62310b-8336-4b45-94c4-b77ed566241a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-33ea0c05-21f7-4393-9cb9-fad16d5f4407" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-33ea0c05-21f7-4393-9cb9-fad16d5f4407" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Deleting offline snapshot 33ea0c05-21f7-4393-9cb9-fad16d5f4407 of volume dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] snapshot_file for this snap is: volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4fa3cd-1804-4eb8-b473-7fc116fcb4e3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:00 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 Apr 29 19:19:00 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:00 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe 1073741824" returned: 0 in 0.786s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:00 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe Apr 29 19:19:00 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:00 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407" returned: 0 in 0.752s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc62310b-8336-4b45-94c4-b77ed566241a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bbcfbb-6624-4d98-b267-0792a9e4070b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:00 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a Apr 29 19:19:00 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:01 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe" returned: 0 in 0.609s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcdf97b-bb17-472e-9355-46fdb3b218b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adc5e5e-9a1e-445e-a2ee-959dfdc0ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:01 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Volume volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe (6890a90c-cd34-49d1-95f3-cf3f5509f2fe): created successfully Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adc5e5e-9a1e-445e-a2ee-959dfdc0ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (8cbd6bd3-331c-40ce-9d53-bc740bac0485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0050bc63-e870-41d7-9aff-33689c82675d tempest-VolumesActionsTest-899685905 None] Created volume successfully. Apr 29 19:19:01 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a" returned: 0 in 0.697s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:01 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 Apr 29 19:19:01 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:02 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407" returned: 0 in 0.752s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:02 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407 Apr 29 19:19:02 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-6890a90c-cd34-49d1-95f3-cf3f5509f2fe-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Lock "cinder-6890a90c-cd34-49d1-95f3-cf3f5509f2fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-quobyte-6890a90c-cd34-49d1-95f3-cf3f5509f2fe" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Lock "cinder-quobyte-6890a90c-cd34-49d1-95f3-cf3f5509f2fe" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f513173d-1748-4f5f-88f3-4bd0a778fa8e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:02 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe Apr 29 19:19:02 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:02 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a.33ea0c05-21f7-4393-9cb9-fad16d5f4407" returned: 0 in 0.591s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-33ea0c05-21f7-4393-9cb9-fad16d5f4407" released by "_delete_snapshot" :: held 2.892s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-dc62310b-8336-4b45-94c4-b77ed566241a" released by "delete_snapshot" :: held 2.915s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Created reservations ['d5772c66-1496-4e88-b9ba-3e6285dec2a9', '675f95de-28b8-4790-af70-82176e933ae3', '19f4449f-d2d9-48cd-9452-ff3ebae5fdf7', 'b9947746-6e3b-40d9-9fcf-8789084e2ed3'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:03 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Delete snapshot completed successfully. Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0f462cdb-d198-4c92-a33d-20654248f461 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-33ea0c05-21f7-4393-9cb9-fad16d5f4407-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-dc62310b-8336-4b45-94c4-b77ed566241a-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:03 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe" returned: 0 in 0.724s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Lock "cinder-dc62310b-8336-4b45-94c4-b77ed566241a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:03 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe Apr 29 19:19:03 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-dc62310b-8336-4b45-94c4-b77ed566241a" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-dc62310b-8336-4b45-94c4-b77ed566241a" acquired by "delete_volume" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1097220f-f15b-41da-b057-a0073d1d4983]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:03 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a Apr 29 19:19:03 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:03 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6890a90c-cd34-49d1-95f3-cf3f5509f2fe" returned: 0 in 0.587s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Lock "cinder-quobyte-6890a90c-cd34-49d1-95f3-cf3f5509f2fe" released by "delete_volume" :: held 1.360s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Created reservations ['03e1d4b5-6d17-4a6d-83ab-c85d95daeefc', 'f43ff9e3-45d2-4ada-ab04-0e0491d98d17', 'd0066c49-b0e7-49ba-b645-691992a3430b', '2deaf05c-a517-4ab9-93c6-ccf43d2cb15c'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:03 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:03 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:04 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a" returned: 0 in 0.734s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:04 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a Apr 29 19:19:04 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:04 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.595s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:04 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Deleted volume successfully. Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8e294542-60c9-4839-b48d-17313295e9cd tempest-VolumesActionsTest-788449285 None] Lock "cinder-6890a90c-cd34-49d1-95f3-cf3f5509f2fe-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:04 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-dc62310b-8336-4b45-94c4-b77ed566241a" returned: 0 in 0.649s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-dc62310b-8336-4b45-94c4-b77ed566241a" released by "delete_volume" :: held 1.438s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Created reservations ['90f2f6bc-9586-458f-a39b-058adfaf951e', '91f6b371-b611-4468-8655-e6c664234afb', '66a8fdb0-f48b-4c66-bdff-ab17154985b2', 'cfc12b09-ac70-4116-b0ee-6665474363d7'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:04 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:04 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (14fda745-729d-4ca4-8ea1-83e20abb553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0900025d-7779-4bb6-8ad3-d24e854a877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0900025d-7779-4bb6-8ad3-d24e854a877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607802763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f731ab2d-6ac2-4d4c-861a-f3b14b2be52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:05Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada3ec55-09fd-4e6b-857b-ea8d22cdd54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada3ec55-09fd-4e6b-857b-ea8d22cdd54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f857306-a332-4dd4-8675-c41f78c28347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f857306-a332-4dd4-8675-c41f78c28347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f731ab2d-6ac2-4d4c-861a-f3b14b2be52d', 'volume_name': 'volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d789a6cd-bc47-4522-bd32-61a2df806ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d789a6cd-bc47-4522-bd32-61a2df806ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc215a45-17d8-4493-96c6-c9f46061dfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Volume f731ab2d-6ac2-4d4c-861a-f3b14b2be52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d', 'volume_size': 1} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607802763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f731ab2d-6ac2-4d4c-861a-f3b14b2be52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:05Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Creating volume f731ab2d-6ac2-4d4c-861a-f3b14b2be52d {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:19:05 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:05 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d 1073741824 Apr 29 19:19:05 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:05 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.625s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:05 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Deleted volume successfully. Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-83f7b442-778b-4d8f-a15f-07aa639b6a7d tempest-VolumeDependencyTests-554922787 None] Lock "cinder-dc62310b-8336-4b45-94c4-b77ed566241a-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Flow 'volume_create_manager' (596d53a3-4822-4a18-9cb1-89e5df426e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbe0dc6-0706-4717-be3a-16650814debd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbe0dc6-0706-4717-be3a-16650814debd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1822869744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e89787-30ac-49cd-9e35-dbeca5cf3d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60126a349f9648989539d21528bfaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:06Z,use_quota=True,user_id='bc51dae4a4f24fb0bd889add43e9e27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac5a88f-0fb7-4b48-8764-dba23674befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac5a88f-0fb7-4b48-8764-dba23674befc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1febc35e-7dd2-4b6e-901c-8760bd79600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1febc35e-7dd2-4b6e-901c-8760bd79600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e89787-30ac-49cd-9e35-dbeca5cf3d8c', 'volume_name': 'volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff4a505-f1f0-4c07-b3b5-31908e7d6244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff4a505-f1f0-4c07-b3b5-31908e7d6244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe78fff-b22f-4ac3-9f13-69bc5c803529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:05 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Volume 57e89787-30ac-49cd-9e35-dbeca5cf3d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c', 'volume_size': 1} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:05 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d 1073741824" returned: 0 in 0.800s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:05 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d Apr 29 19:19:06 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:06 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d" returned: 0 in 0.594s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1822869744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e89787-30ac-49cd-9e35-dbeca5cf3d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60126a349f9648989539d21528bfaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:06Z,use_quota=True,user_id='bc51dae4a4f24fb0bd889add43e9e27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Creating volume 57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:19:06 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:06 devstack sudo[92050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c 1073741824 Apr 29 19:19:06 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc215a45-17d8-4493-96c6-c9f46061dfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986be2a4-425a-4cb1-96b7-17afadc5a022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:06 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Volume volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d (f731ab2d-6ac2-4d4c-861a-f3b14b2be52d): created successfully Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986be2a4-425a-4cb1-96b7-17afadc5a022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (14fda745-729d-4ca4-8ea1-83e20abb553f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:06 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2b5b837d-39f0-4b55-b7f6-d3a1cee5cb77 tempest-VolumesActionsTest-899685905 None] Created volume successfully. Apr 29 19:19:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Lock "cinder-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Acquiring lock "cinder-quobyte-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:07 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c 1073741824" returned: 0 in 0.800s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Lock "cinder-quobyte-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:07 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6859389-8b01-47d9-b61d-4413633d9406]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:07 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c Apr 29 19:19:07 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:07 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d Apr 29 19:19:07 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:08 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" returned: 0 in 0.614s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe78fff-b22f-4ac3-9f13-69bc5c803529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c005aca8-fbe9-4da9-9a33-658747079194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:08 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Volume volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c (57e89787-30ac-49cd-9e35-dbeca5cf3d8c): created successfully Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c005aca8-fbe9-4da9-9a33-658747079194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Flow 'volume_create_manager' (596d53a3-4822-4a18-9cb1-89e5df426e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:08 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d" returned: 0 in 0.686s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:08 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f355619a-e86c-4f42-8689-0f66830352e5 tempest-VolumeDependencyTests-554922787 None] Created volume successfully. Apr 29 19:19:08 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d Apr 29 19:19:08 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:08 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d" returned: 0 in 0.582s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Lock "cinder-quobyte-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d" released by "delete_volume" :: held 1.305s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Created reservations ['877bc067-d07c-4a4d-a730-9f7e8dc3342a', 'b4f9beb1-54bc-48e3-bfdd-3cd491770e8d', 'b5bb1c3d-8575-492f-8719-aea1a2951d52', '34bc592d-93bb-4b51-8b66-606d6a42cbfc'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:08 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:08 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:09 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.592s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:09 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Deleted volume successfully. Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Flow 'volume_create_manager' (a761fca8-af51-4737-bb9a-768cf84ef55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc7a00b-3ab6-40b7-9d09-b14e90ef95a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc7a00b-3ab6-40b7-9d09-b14e90ef95a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1403837936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4c447a-f5c5-4d72-91d1-cd5bd7267b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60126a349f9648989539d21528bfaa6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=57e89787-30ac-49cd-9e35-dbeca5cf3d8c,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:09Z,use_quota=True,user_id='bc51dae4a4f24fb0bd889add43e9e27c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adeb3704-0063-478e-a7ce-2c321da0a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adeb3704-0063-478e-a7ce-2c321da0a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8809a615-7cd9-453e-b5a2-005702226545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-808c2df5-c3a8-4881-9150-2230284e8d82 tempest-VolumesActionsTest-788449285 None] Lock "cinder-f731ab2d-6ac2-4d4c-861a-f3b14b2be52d-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8809a615-7cd9-453e-b5a2-005702226545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7c4c447a-f5c5-4d72-91d1-cd5bd7267b93', 'volume_name': 'volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93', 'volume_size': 1, 'source_volid': '57e89787-30ac-49cd-9e35-dbeca5cf3d8c', 'source_volstatus': 'available'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28b0f39-2876-421e-b5dd-b73111383867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28b0f39-2876-421e-b5dd-b73111383867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adeb303-975c-454f-ac8a-6f04447e857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:09 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Volume 7c4c447a-f5c5-4d72-91d1-cd5bd7267b93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93', 'volume_size': 1, 'source_volid': '57e89787-30ac-49cd-9e35-dbeca5cf3d8c', 'source_volstatus': 'available'} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:09 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Cloning volume 57e89787-30ac-49cd-9e35-dbeca5cf3d8c to volume 7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Creating offline snapshot 55071d0a-951e-4bfe-b347-47ff9264272d of volume 57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5387482-1be6-44b1-a562-dc35b667f0ce]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:09 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c Apr 29 19:19:09 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (22f41b29-7612-4d75-87ab-d66756aac083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9741eaf-6695-45e8-8e3e-7fd03787ba81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9741eaf-6695-45e8-8e3e-7fd03787ba81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107056666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d716a31e-0c50-4def-a92d-b6cd62b1c96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:10Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb0e317-1a93-4f8e-ba1b-f5dfe4ddb215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb0e317-1a93-4f8e-ba1b-f5dfe4ddb215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b576754-e104-4b7c-ae40-88ed348caa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:09 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b576754-e104-4b7c-ae40-88ed348caa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd716a31e-0c50-4def-a92d-b6cd62b1c96b', 'volume_name': 'volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cb440e-3b3a-44f1-b2d5-279b5f8cb5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cb440e-3b3a-44f1-b2d5-279b5f8cb5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a77a969-4fd5-4378-a72f-cecb20731450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:10 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Volume d716a31e-0c50-4def-a92d-b6cd62b1c96b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b', 'volume_size': 1} Apr 29 19:19:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:10 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" returned: 0 in 0.713s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:10 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d 1G Apr 29 19:19:10 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:11 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d 1G" returned: 0 in 0.767s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:11 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d Apr 29 19:19:11 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:11 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d" returned: 0 in 0.639s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:11 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d is being set with open permissions: ugo+rw Apr 29 19:19:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:11 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d Apr 29 19:19:11 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:12 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d" returned: 0 in 0.597s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:12 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.info Apr 29 19:19:12 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:12 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.info" returned: 0 in 0.595s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:12 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.info is being set with open permissions: ugo+rw Apr 29 19:19:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:12 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.info Apr 29 19:19:12 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:13 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.info" returned: 0 in 0.586s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] snapshot: 55071d0a-951e-4bfe-b347-47ff9264272d, volume: 7c4c447a-f5c5-4d72-91d1-cd5bd7267b93, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57eb352-7a79-4bc3-8f51-a762b590dd15]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:13 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d Apr 29 19:19:13 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:14 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d" returned: 0 in 0.699s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20f7ab8-c6e7-4b36-aa5c-1e2f73f04a56]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:14 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c Apr 29 19:19:14 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:14 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" returned: 0 in 0.687s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:19:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:14 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 Apr 29 19:19:14 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:19 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" returned: 0 in 4.523s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:19 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddf5342-fe7c-4a67-8e44-353c44c353d5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:19 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c Apr 29 19:19:19 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:20 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" returned: 0 in 0.856s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:20 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:19:20 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Converted 1024.00 MB image at 226.32 MB/s Apr 29 19:19:20 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 is being set with open permissions: ugo+rw Apr 29 19:19:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:20 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 Apr 29 19:19:20 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:20 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" returned: 0 in 0.584s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" released by "_copy_volume_from_snapshot" :: held 7.424s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-55071d0a-951e-4bfe-b347-47ff9264272d" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-55071d0a-951e-4bfe-b347-47ff9264272d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Deleting offline snapshot 55071d0a-951e-4bfe-b347-47ff9264272d of volume 57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:19:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] snapshot_file for this snap is: volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:19:21 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a5900c-48b7-4bcb-8c8c-a40ba88074e0]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:21 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d Apr 29 19:19:21 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:21 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d" returned: 0 in 0.705s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:19:21 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[728615ec-c8a8-4b79-9a76-01cdee576f3e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:21 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c Apr 29 19:19:21 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:22 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" returned: 0 in 0.691s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:22 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d Apr 29 19:19:22 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:23 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d" returned: 0 in 0.659s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:23 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d Apr 29 19:19:23 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:23 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c.55071d0a-951e-4bfe-b347-47ff9264272d" returned: 0 in 0.605s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-55071d0a-951e-4bfe-b347-47ff9264272d" released by "_delete_snapshot" :: held 2.749s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.245s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.755s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107056666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d716a31e-0c50-4def-a92d-b6cd62b1c96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1869cf62e84a4ae7ab21017a8cc6cdd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:10Z,use_quota=True,user_id='539f4ab5d0064e80b82e394c5440b0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Creating volume d716a31e-0c50-4def-a92d-b6cd62b1c96b {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:19:23 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adeb303-975c-454f-ac8a-6f04447e857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93', 'volume_size': 1, 'source_volid': '57e89787-30ac-49cd-9e35-dbeca5cf3d8c', 'source_volstatus': 'available'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:23 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b 1073741824 Apr 29 19:19:23 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b36a95-f0bf-406c-805b-27115550652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:23 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Volume volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 (7c4c447a-f5c5-4d72-91d1-cd5bd7267b93): created successfully Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b36a95-f0bf-406c-805b-27115550652f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Flow 'volume_create_manager' (a761fca8-af51-4737-bb9a-768cf84ef55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:23 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ea04ed70-7dbf-48cf-8762-506be4b6a2c0 tempest-VolumeDependencyTests-554922787 None] Created volume successfully. Apr 29 19:19:24 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-57e89787-30ac-49cd-9e35-dbeca5cf3d8c-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b 1073741824" returned: 0 in 0.848s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Lock "cinder-57e89787-30ac-49cd-9e35-dbeca5cf3d8c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:24 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b Apr 29 19:19:24 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" acquired by "delete_volume" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:24 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c617892-b938-4e82-babf-25fcbb7433d1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:24 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c Apr 29 19:19:24 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:25 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b" returned: 0 in 0.611s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a77a969-4fd5-4378-a72f-cecb20731450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a32436-979e-41a9-ab52-0a40bdbbbfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:25 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Volume volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b (d716a31e-0c50-4def-a92d-b6cd62b1c96b): created successfully Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a32436-979e-41a9-ab52-0a40bdbbbfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Flow 'volume_create_manager' (22f41b29-7612-4d75-87ab-d66756aac083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:25 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5d35a2f6-eb72-4b71-a178-4d0678759771 tempest-VolumesActionsTest-899685905 None] Created volume successfully. Apr 29 19:19:25 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" returned: 0 in 0.727s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:25 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c Apr 29 19:19:25 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:26 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" returned: 0 in 0.617s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-57e89787-30ac-49cd-9e35-dbeca5cf3d8c" released by "delete_volume" :: held 1.414s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Created reservations ['7ba411cc-795f-44b5-900f-19c10a67aac6', 'fabf432b-e070-48b6-904f-2801b2b84e4f', '7a5188f3-4b38-4340-b2f3-166e71082751', 'dd15e90a-2990-4df1-b218-867b52660fc0'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:26 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:26 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Acquiring lock "cinder-d716a31e-0c50-4def-a92d-b6cd62b1c96b-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Lock "cinder-d716a31e-0c50-4def-a92d-b6cd62b1c96b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Acquiring lock "cinder-quobyte-d716a31e-0c50-4def-a92d-b6cd62b1c96b" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Lock "cinder-quobyte-d716a31e-0c50-4def-a92d-b6cd62b1c96b" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06ace4d-7f01-4168-a782-fa8a4425ae78]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:26 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.622s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:26 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b Apr 29 19:19:26 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:26 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Deleted volume successfully. Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6390fbcf-87df-4d36-9797-e07327a3b62c tempest-VolumeDependencyTests-554922787 None] Lock "cinder-57e89787-30ac-49cd-9e35-dbeca5cf3d8c-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482e6af-7b5f-477e-be41-cbc07a79ed0f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:27 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 Apr 29 19:19:27 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:27 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b" returned: 0 in 0.789s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:27 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b Apr 29 19:19:27 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:27 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" returned: 0 in 0.733s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:27 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93 Apr 29 19:19:27 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:28 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d716a31e-0c50-4def-a92d-b6cd62b1c96b" returned: 0 in 0.611s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Lock "cinder-quobyte-d716a31e-0c50-4def-a92d-b6cd62b1c96b" released by "delete_volume" :: held 1.441s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=117,cinder:SELECT=76,cinder:INSERT=31,cinder:DELETE=7 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=91,cinder:INSERT=19,cinder:UPDATE=96,cinder:DELETE=12 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Created reservations ['d846b31c-2dd5-4a88-92ca-cf3b5c3b05ef', '8808f33a-5d0b-43e3-bfa2-52bda2aa8a4d', 'ab0d07c2-913d-4cd7-a1aa-12102fa905f4', 'cfec8afa-1d05-4504-9ca5-ecc6591f63ea'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:28 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:28 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:28 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" returned: 0 in 0.637s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93" released by "delete_volume" :: held 1.422s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Created reservations ['ff860b4f-a72c-4ffe-b98b-96a619e0cd0c', '087d2d9e-c975-4d44-b549-49a1e90fb573', 'a078572d-9ea1-44f9-9838-34b778130688', 'e3dae499-cb9f-4fc6-8b0b-d76d545adb2a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:28 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:28 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:28 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.627s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:28 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Deleted volume successfully. Apr 29 19:19:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d47b1988-cc65-47aa-bb3d-357019251eb5 tempest-VolumesActionsTest-899685905 None] Lock "cinder-d716a31e-0c50-4def-a92d-b6cd62b1c96b-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:29 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.597s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:29 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Deleted volume successfully. Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-a010a859-d98f-487f-b38f-b90251cd4af3 tempest-VolumeDependencyTests-554922787 None] Lock "cinder-7c4c447a-f5c5-4d72-91d1-cd5bd7267b93-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-0c413731-2d18-47ae-b3e5-8448db55fd10-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Lock "cinder-0c413731-2d18-47ae-b3e5-8448db55fd10-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Acquiring lock "cinder-quobyte-0c413731-2d18-47ae-b3e5-8448db55fd10" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-0c413731-2d18-47ae-b3e5-8448db55fd10" acquired by "delete_volume" :: waited 0.013s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c65aac9-e762-44fe-90aa-5672978d6337]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:29 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 Apr 29 19:19:29 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:29 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:29 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:30 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10" returned: 0 in 0.738s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:30 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10 Apr 29 19:19:30 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:30 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.695s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:19:30 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-0c413731-2d18-47ae-b3e5-8448db55fd10" returned: 0 in 0.648s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Lock "cinder-quobyte-0c413731-2d18-47ae-b3e5-8448db55fd10" released by "delete_volume" :: held 1.433s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Created reservations ['d90e847b-3ba9-49a4-95f8-0831cbd1d6a3', 'f133838f-a8cb-464c-9cad-138337458912', '9377a6d9-e242-4b8a-ab3c-4ce1b06e235b', '418c44c6-0d3f-4482-923c-2542dfa46bdf'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:30 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:30 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:31 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.616s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:31 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:31 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Deleted volume successfully. Apr 29 19:19:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5f0b3d1e-fa74-448e-b71c-5d3cc70dfddf tempest-VolumeDependencyTests-554922787 None] Lock "cinder-0c413731-2d18-47ae-b3e5-8448db55fd10-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Flow 'volume_create_manager' (f6a3dd8f-090d-42f8-9097-43a116c6971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e621cd04-5213-431f-8230-13c4bd350343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e621cd04-5213-431f-8230-13c4bd350343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-371673160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4d238d-a831-47b6-944e-766f7f0dcf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0162ad573d147dbabc8cbb9f1aa0e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:40Z,use_quota=True,user_id='fc0578ed602c492e855aa4a5a409a3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cd4574-d48e-4f82-94a3-1ffb6c6adf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cd4574-d48e-4f82-94a3-1ffb6c6adf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3839d9f4-f9ab-48cb-b9da-154cca52bf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3839d9f4-f9ab-48cb-b9da-154cca52bf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4d238d-a831-47b6-944e-766f7f0dcf04', 'volume_name': 'volume-bc4d238d-a831-47b6-944e-766f7f0dcf04', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bf7e5f-370f-48e8-be4a-b436f5e388ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bf7e5f-370f-48e8-be4a-b436f5e388ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b29b8c-b3ed-48b2-9e79-d180240741f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:39 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Volume bc4d238d-a831-47b6-944e-766f7f0dcf04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4d238d-a831-47b6-944e-766f7f0dcf04', 'volume_size': 1} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-371673160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4d238d-a831-47b6-944e-766f7f0dcf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0162ad573d147dbabc8cbb9f1aa0e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:40Z,use_quota=True,user_id='fc0578ed602c492e855aa4a5a409a3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Creating volume bc4d238d-a831-47b6-944e-766f7f0dcf04 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:19:39 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:19:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:39 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 1073741824 Apr 29 19:19:39 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:40 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 1073741824" returned: 0 in 0.739s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:40 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 Apr 29 19:19:40 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:41 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04" returned: 0 in 0.573s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:19:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b29b8c-b3ed-48b2-9e79-d180240741f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4d238d-a831-47b6-944e-766f7f0dcf04', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5795ee59-77a9-42bf-8f2b-c63c854a802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:41 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Volume volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 (bc4d238d-a831-47b6-944e-766f7f0dcf04): created successfully Apr 29 19:19:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5795ee59-77a9-42bf-8f2b-c63c854a802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Flow 'volume_create_manager' (f6a3dd8f-090d-42f8-9097-43a116c6971a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:41 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-57855e54-d5e9-467f-af8b-358bc5c28692 tempest-VolumesTransfersV355Test-1382974708 None] Created volume successfully. Apr 29 19:19:42 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5ea26e66-53d9-49e3-bcf1-1ddf57232fde tempest-VolumesTransfersV355Test-1301760934 None] Transfer volume completed successfully. Apr 29 19:19:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Acquiring lock "cinder-bc4d238d-a831-47b6-944e-766f7f0dcf04-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Lock "cinder-bc4d238d-a831-47b6-944e-766f7f0dcf04-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Acquiring lock "cinder-quobyte-bc4d238d-a831-47b6-944e-766f7f0dcf04" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Lock "cinder-quobyte-bc4d238d-a831-47b6-944e-766f7f0dcf04" acquired by "delete_volume" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:43 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3fa50-a8a4-4c22-a8d7-4515e026bdba]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:43 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 Apr 29 19:19:43 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:44 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04" returned: 0 in 0.683s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:44 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04 Apr 29 19:19:44 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:44 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-bc4d238d-a831-47b6-944e-766f7f0dcf04" returned: 0 in 0.575s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Lock "cinder-quobyte-bc4d238d-a831-47b6-944e-766f7f0dcf04" released by "delete_volume" :: held 1.296s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Created reservations ['e818ba52-13a1-4087-b9e1-eefe7a6d0e5e', 'b415fa13-215f-4348-a5b9-b4cc75325d24', '0e115edf-f48d-47bf-bc93-bfce8d9e730a', '3e9018d4-91a7-4e81-ac7d-dc2e6beccf71'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:44 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:44 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:45 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.569s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Deleted volume successfully. Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39ea9a3b-f557-4d8d-b27c-82b4463949f2 tempest-VolumesTransfersV355Test-1513189326 None] Lock "cinder-bc4d238d-a831-47b6-944e-766f7f0dcf04-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Flow 'volume_create_manager' (1cc92f5d-43a0-4309-80c4-2e2300cae352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69619973-61d8-4494-953d-03a48a3a59c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69619973-61d8-4494-953d-03a48a3a59c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1454306334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35b460b-c9e2-4b7c-b45e-34f3c72cedeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0162ad573d147dbabc8cbb9f1aa0e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:46Z,use_quota=True,user_id='fc0578ed602c492e855aa4a5a409a3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b85b0e4-5b6b-4483-bd5c-d3b0417b1588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b85b0e4-5b6b-4483-bd5c-d3b0417b1588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236d7f64-f57c-4044-96d9-b98641b39f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236d7f64-f57c-4044-96d9-b98641b39f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35b460b-c9e2-4b7c-b45e-34f3c72cedeb', 'volume_name': 'volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a68c8e-eff9-4949-9043-c5fc03f66668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a68c8e-eff9-4949-9043-c5fc03f66668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1204f27-5e09-4111-a604-cf1ad3f77e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Volume e35b460b-c9e2-4b7c-b45e-34f3c72cedeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb', 'volume_size': 1} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1454306334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35b460b-c9e2-4b7c-b45e-34f3c72cedeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0162ad573d147dbabc8cbb9f1aa0e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:46Z,use_quota=True,user_id='fc0578ed602c492e855aa4a5a409a3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Creating volume e35b460b-c9e2-4b7c-b45e-34f3c72cedeb {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:19:46 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:19:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:46 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb 1073741824 Apr 29 19:19:46 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:46 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb 1073741824" returned: 0 in 0.734s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:46 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb Apr 29 19:19:46 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:47 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb" returned: 0 in 0.579s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:19:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1204f27-5e09-4111-a604-cf1ad3f77e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe23bd0-a191-4cb8-af59-a5bb3914cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:47 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Volume volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb (e35b460b-c9e2-4b7c-b45e-34f3c72cedeb): created successfully Apr 29 19:19:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe23bd0-a191-4cb8-af59-a5bb3914cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Flow 'volume_create_manager' (1cc92f5d-43a0-4309-80c4-2e2300cae352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:47 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-631fee65-d9ef-49ef-b07d-c4684fbf586d tempest-VolumesTransfersV355Test-1382974708 None] Created volume successfully. Apr 29 19:19:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Acquiring lock "cinder-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Lock "cinder-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Acquiring lock "cinder-quobyte-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:19:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Lock "cinder-quobyte-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:19:48 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[148b62a1-d92b-4b4b-8362-9261f5fb6589]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:48 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb Apr 29 19:19:48 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:49 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb" returned: 0 in 0.684s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:49 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb Apr 29 19:19:49 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:49 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb" returned: 0 in 0.621s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Lock "cinder-quobyte-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb" released by "delete_volume" :: held 1.346s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Created reservations ['2cc53400-d49e-44a3-931b-44353eefbef5', '03815fff-8557-4a4e-a07f-3201a9b73fef', '054c09ff-c326-48f1-b7c3-bff8fa07b449', '5ccd0b22-f75b-4a11-b1e9-967f0b735b88'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:49 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:19:49 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:50 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.577s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:50 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:19:50 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Deleted volume successfully. Apr 29 19:19:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5076c8aa-2df5-4e2c-bbe1-058e6de9348a tempest-VolumesTransfersV355Test-1513189326 None] Lock "cinder-e35b460b-c9e2-4b7c-b45e-34f3c72cedeb-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Flow 'volume_create_manager' (7d6969b7-5a06-40bf-8ba5-b429015929c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7d5109-88b5-46de-9198-8d3acf417fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7d5109-88b5-46de-9198-8d3acf417fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1316927211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ca26a0-4b92-432c-aea0-236f1ec25986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21fd1e27fd84b18aa19e719213d20b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:55Z,use_quota=True,user_id='122f359941984165a5fea10474ac9c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9f63c2-8d81-4acb-8d87-10a72874a7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9f63c2-8d81-4acb-8d87-10a72874a7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e328ced7-cfeb-4a77-bf8e-15ef81fca49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.image.glance [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Creating Keystone auth plugin from conf {{(pid=84523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e328ced7-cfeb-4a77-bf8e-15ef81fca49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6ca26a0-4b92-432c-aea0-236f1ec25986', 'volume_name': 'volume-a6ca26a0-4b92-432c-aea0-236f1ec25986', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9776e52c-36e6-4952-b476-e8daf9c6c0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9776e52c-36e6-4952-b476-e8daf9c6c0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90d667f-83ce-4394-9441-681ea728c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:19:55 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Volume a6ca26a0-4b92-432c-aea0-236f1ec25986: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6ca26a0-4b92-432c-aea0-236f1ec25986', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Trying to clone a6ca26a0-4b92-432c-aea0-236f1ec25986 from image f7bc816f-25b0-408e-baa1-85adebe218d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]). {{(pid=84523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 19:19:55 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Image download 20.69 MB at 20.69 MB/s Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ede5b-ff17-41e2-8fca-d9682e748f7b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:56 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD Apr 29 19:19:56 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:56 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD" returned: 0 in 0.662s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:56 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Temporary image f7bc816f-25b0-408e-baa1-85adebe218d0 is fetched for user 122f359941984165a5fea10474ac9c67. {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 19:19:56 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbd561f-a742-4ae3-878e-18ad230a4e87]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:56 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD Apr 29 19:19:56 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:57 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD" returned: 0 in 0.680s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1316927211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ca26a0-4b92-432c-aea0-236f1ec25986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21fd1e27fd84b18aa19e719213d20b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:19:55Z,use_quota=True,user_id='122f359941984165a5fea10474ac9c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Creating volume a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:19:57 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:19:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:57 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 1073741824 Apr 29 19:19:57 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:58 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 1073741824" returned: 0 in 0.737s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:58 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:19:58 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:58 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 0 in 0.603s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:19:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:19:58 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Attempting download of f7bc816f-25b0-408e-baa1-85adebe218d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}])) to volume a6ca26a0-4b92-432c-aea0-236f1ec25986. {{(pid=84523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 29 19:19:58 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f3e020-94eb-40ed-a8b6-389f51746ddf]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:19:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_9m7h0lne {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:58 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_9m7h0lne Apr 29 19:19:58 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:19:59 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Apr 29 19:19:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_9m7h0lne" returned: 0 in 0.676s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:19:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_9m7h0lne {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:19:59 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_9m7h0lne Apr 29 19:19:59 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:00 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_9m7h0lne" returned: 1 in 0.659s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7bc816f-25b0-408e-baa1-85adebe218d0_9m7h0lne' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:20:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfb49a6-58ab-43ae-b065-9441bac35eeb]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:00 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD Apr 29 19:20:00 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:00 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:00 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] f7bc816f-25b0-408e-baa1-85adebe218d0 was qcow2, converting to raw {{(pid=84523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 19:20:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:00 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:20:00 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:02 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 0 in 1.764s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:02 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7bc816f-25b0-408e-baa1-85adebe218d0_glld74fjdevstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:20:02 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Converted 112.00 MB image at 63.43 MB/s Apr 29 19:20:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:02 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 1G Apr 29 19:20:02 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:03 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 1G" returned: 0 in 0.623s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:03 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[350d98d1-070e-458f-ac66-beb5c316b11e]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:03 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:20:03 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:03 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 0 in 0.686s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:04 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:20:04 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:04 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 1 in 0.678s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Downloaded image f7bc816f-25b0-408e-baa1-85adebe218d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}])) to volume a6ca26a0-4b92-432c-aea0-236f1ec25986 successfully. {{(pid=84523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Temporary image f7bc816f-25b0-408e-baa1-85adebe218d0 for user 122f359941984165a5fea10474ac9c67 is deleted. {{(pid=84523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.volume.volume_utils [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Marking volume a6ca26a0-4b92-432c-aea0-236f1ec25986 as bootable. {{(pid=84523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Copying metadata from image f7bc816f-25b0-408e-baa1-85adebe218d0 to a6ca26a0-4b92-432c-aea0-236f1ec25986. {{(pid=84523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Creating volume glance metadata for volume a6ca26a0-4b92-432c-aea0-236f1ec25986 backed by image f7bc816f-25b0-408e-baa1-85adebe218d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90d667f-83ce-4394-9441-681ea728c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ca26a0-4b92-432c-aea0-236f1ec25986', 'volume_size': 1, 'image_id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7bc816f-25b0-408e-baa1-85adebe218d0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f645be536b3d49a296d5fcb5f19ac05e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f7bc816f-25b0-408e-baa1-85adebe218d0', 'created_at': datetime.datetime(2026, 4, 29, 17, 4, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 17, 4, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7bc816f-25b0-408e-baa1-85adebe218d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c4fd05-2a7a-4870-9126-6989ffc0acde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:04 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Volume volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 (a6ca26a0-4b92-432c-aea0-236f1ec25986): created successfully Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c4fd05-2a7a-4870-9126-6989ffc0acde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Flow 'volume_create_manager' (7d6969b7-5a06-40bf-8ba5-b429015929c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:04 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-91e73481-6673-43d1-8612-dda522330a13 tempest-VolumesExtendTest-1224249874 None] Created volume successfully. Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[513eb09f-206e-4b10-a47c-696e47cf96ea]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:05 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:20:05 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:05 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 0 in 0.673s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:05 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:20:05 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:06 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 1 in 0.679s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:20:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 2G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 2G" returned: 0 in 0.059s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.456s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:06 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ebd17901-e474-4afc-910f-45ebcd88605d tempest-VolumesExtendTest-1224249874 None] Extend volume completed successfully. Apr 29 19:20:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Acquiring lock "cinder-a6ca26a0-4b92-432c-aea0-236f1ec25986-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Lock "cinder-a6ca26a0-4b92-432c-aea0-236f1ec25986-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Acquiring lock "cinder-quobyte-a6ca26a0-4b92-432c-aea0-236f1ec25986" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Lock "cinder-quobyte-a6ca26a0-4b92-432c-aea0-236f1ec25986" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:07 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1f6f81-5b3f-44ff-965d-1beb4f902c22]: (4, 'raw') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:07 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:20:07 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:08 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 0 in 0.683s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:08 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:20:08 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:08 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 1 in 0.683s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986' failed. Not Retrying. {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 19:20:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:08 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986 Apr 29 19:20:08 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:09 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-a6ca26a0-4b92-432c-aea0-236f1ec25986" returned: 0 in 0.589s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Lock "cinder-quobyte-a6ca26a0-4b92-432c-aea0-236f1ec25986" released by "delete_volume" :: held 2.020s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Created reservations ['a79ee3ff-79a8-4a67-b04f-06bfcb0bd578', '7f858497-af28-4d99-8ff6-d17711947e42', '6501ccf9-2bb2-4bfe-9cba-eced4399c5fe', 'd13ed6bf-71ea-47d3-ba95-4f6d0177dbc9'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:09 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:20:09 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:10 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.591s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:20:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Deleted volume successfully. Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b8372fb-5379-46e2-8fb4-5a6e50b1388e tempest-VolumesExtendTest-1224249874 None] Lock "cinder-a6ca26a0-4b92-432c-aea0-236f1ec25986-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Flow 'volume_create_manager' (9991f6cf-09ca-439a-bb0b-33712be6b5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4480b99-651c-440a-a69c-e941a4d171c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4480b99-651c-440a-a69c-e941a4d171c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-368780198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aec428a-de66-4d5d-845f-9b12542a9d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21fd1e27fd84b18aa19e719213d20b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:20:11Z,use_quota=True,user_id='122f359941984165a5fea10474ac9c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14c980e-7519-42e6-aea9-a62bdae651dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14c980e-7519-42e6-aea9-a62bdae651dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504dd551-42d1-4013-a32e-b4af2eb688a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504dd551-42d1-4013-a32e-b4af2eb688a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aec428a-de66-4d5d-845f-9b12542a9d2a', 'volume_name': 'volume-7aec428a-de66-4d5d-845f-9b12542a9d2a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4774cdb-d322-41b4-afaf-d03dd4334052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4774cdb-d322-41b4-afaf-d03dd4334052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e74185e-1171-4679-bbaf-1329a9841f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:10 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Volume 7aec428a-de66-4d5d-845f-9b12542a9d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aec428a-de66-4d5d-845f-9b12542a9d2a', 'volume_size': 1} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-368780198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aec428a-de66-4d5d-845f-9b12542a9d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21fd1e27fd84b18aa19e719213d20b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:20:11Z,use_quota=True,user_id='122f359941984165a5fea10474ac9c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Creating volume 7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:20:10 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:20:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:10 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a 1073741824 Apr 29 19:20:10 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:11 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a 1073741824" returned: 0 in 0.787s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:11 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a Apr 29 19:20:11 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:12 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a" returned: 0 in 0.574s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:12 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:20:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e74185e-1171-4679-bbaf-1329a9841f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aec428a-de66-4d5d-845f-9b12542a9d2a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab98da1-27c3-40c5-896d-2df9197a3c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:12 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Volume volume-7aec428a-de66-4d5d-845f-9b12542a9d2a (7aec428a-de66-4d5d-845f-9b12542a9d2a): created successfully Apr 29 19:20:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab98da1-27c3-40c5-896d-2df9197a3c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:12 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Flow 'volume_create_manager' (9991f6cf-09ca-439a-bb0b-33712be6b5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:12 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-be40293f-f911-405e-a5bc-bfd2a366c46e tempest-VolumesExtendTest-1224249874 None] Created volume successfully. Apr 29 19:20:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Creating offline snapshot 842c34f9-979a-4cf1-93a0-f2e304e572a4 of volume 7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:20:13 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[728519b6-d33c-4c25-bd03-2ef6df814945]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:13 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a Apr 29 19:20:13 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:13 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a" returned: 0 in 0.693s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:13 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 1G Apr 29 19:20:13 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:14 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 1G" returned: 0 in 0.732s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aec428a-de66-4d5d-845f-9b12542a9d2a -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:14 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aec428a-de66-4d5d-845f-9b12542a9d2a -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 Apr 29 19:20:14 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:15 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aec428a-de66-4d5d-845f-9b12542a9d2a -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4" returned: 0 in 0.638s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:15 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 is being set with open permissions: ugo+rw Apr 29 19:20:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:15 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 Apr 29 19:20:15 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:15 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4" returned: 0 in 0.583s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:15 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.info Apr 29 19:20:15 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:16 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.info" returned: 0 in 0.591s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:16 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.info is being set with open permissions: ugo+rw Apr 29 19:20:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:16 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.info Apr 29 19:20:16 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:17 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.info" returned: 0 in 0.585s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.905s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4bfcd661-28d6-49e9-b18d-6e866e234ce4 tempest-VolumesExtendTest-1224249874 None] Create snapshot completed successfully Apr 29 19:20:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc30a618-6b86-4fc5-b8ec-b6f0aa421ee1 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc30a618-6b86-4fc5-b8ec-b6f0aa421ee1 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:17 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e94768e-4393-4ed0-a683-e4124c215347]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc30a618-6b86-4fc5-b8ec-b6f0aa421ee1 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:17 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a Apr 29 19:20:17 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:18 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc30a618-6b86-4fc5-b8ec-b6f0aa421ee1 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a" returned: 0 in 0.714s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc30a618-6b86-4fc5-b8ec-b6f0aa421ee1 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 2G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc30a618-6b86-4fc5-b8ec-b6f0aa421ee1 tempest-VolumesExtendTest-1224249874 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 2G" returned: 0 in 0.119s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc30a618-6b86-4fc5-b8ec-b6f0aa421ee1 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.865s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-fc30a618-6b86-4fc5-b8ec-b6f0aa421ee1 tempest-VolumesExtendTest-1224249874 None] Extend volume completed successfully. Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "cinder-842c34f9-979a-4cf1-93a0-f2e304e572a4-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-842c34f9-979a-4cf1-93a0-f2e304e572a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "cinder-quobyte-7aec428a-de66-4d5d-845f-9b12542a9d2a" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-quobyte-7aec428a-de66-4d5d-845f-9b12542a9d2a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "cinder-quobyte-842c34f9-979a-4cf1-93a0-f2e304e572a4" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-quobyte-842c34f9-979a-4cf1-93a0-f2e304e572a4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Deleting offline snapshot 842c34f9-979a-4cf1-93a0-f2e304e572a4 of volume 7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] snapshot_file for this snap is: volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2c8ce4-22e6-4f85-9eaf-fe1e18f5143c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:18 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 Apr 29 19:20:18 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:19 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4" returned: 0 in 0.702s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aec428a-de66-4d5d-845f-9b12542a9d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:20:19 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba0bea6-e114-424f-8024-ee8b5eb068f5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:19 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a Apr 29 19:20:19 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:20 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a" returned: 0 in 0.736s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:20 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 Apr 29 19:20:20 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:20 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4" returned: 0 in 0.723s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:20 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4 Apr 29 19:20:20 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:21 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a.842c34f9-979a-4cf1-93a0-f2e304e572a4" returned: 0 in 0.602s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-quobyte-842c34f9-979a-4cf1-93a0-f2e304e572a4" released by "_delete_snapshot" :: held 2.867s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-quobyte-7aec428a-de66-4d5d-845f-9b12542a9d2a" released by "delete_snapshot" :: held 2.888s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Created reservations ['3a3734e2-e097-472e-a237-28b96c4686aa', 'a3dbf491-a113-47c1-af82-eb2b5a03167c', '84f1dc9c-ee55-4499-bb4a-ffc52250c2fe', '19af849c-48d9-4d47-ac18-f501b6c4377b'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:20:21 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Delete snapshot completed successfully. Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ddbb4554-09ac-4389-8251-6e54719d4122 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-842c34f9-979a-4cf1-93a0-f2e304e572a4-delete_snapshot" released by "delete_snapshot" :: held 3.015s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "cinder-7aec428a-de66-4d5d-845f-9b12542a9d2a-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-7aec428a-de66-4d5d-845f-9b12542a9d2a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "cinder-quobyte-7aec428a-de66-4d5d-845f-9b12542a9d2a" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-quobyte-7aec428a-de66-4d5d-845f-9b12542a9d2a" acquired by "delete_volume" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be4e7e-5979-4d36-b069-4f5d08df42e4]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:22 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a Apr 29 19:20:22 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:22 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a" returned: 0 in 0.733s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:22 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a Apr 29 19:20:22 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:23 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7aec428a-de66-4d5d-845f-9b12542a9d2a" returned: 0 in 0.578s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-quobyte-7aec428a-de66-4d5d-845f-9b12542a9d2a" released by "delete_volume" :: held 1.363s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Created reservations ['9e863ecf-2ab5-41f8-b0e0-2857a8de1ca5', 'cdd3747a-799d-453c-a3b5-7b94faa95478', '6676ee10-1058-4c4e-98ee-b504f5e26d0e', '68ba9e94-a4a2-4d08-bf28-e01125345fc9'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:23 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:20:23 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:23 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.569s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:23 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:20:24 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Deleted volume successfully. Apr 29 19:20:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b729cd6d-075e-4d9f-871a-111580ac0d19 tempest-VolumesExtendTest-1224249874 None] Lock "cinder-7aec428a-de66-4d5d-845f-9b12542a9d2a-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Flow 'volume_create_manager' (33da24e9-563a-4c54-a32d-7d180d1f7af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e481b50-1b52-4fb5-a019-8f5c1a134095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e481b50-1b52-4fb5-a019-8f5c1a134095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-611668163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71d9340-6dba-4375-a372-bc857b0dd9b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799d1caa1d57459ea19ac27d3831b07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:20:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:20:27Z,use_quota=True,user_id='1d37a6b9cf634ce6aa74debf52cc8d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f2c4ed-f213-44bb-a52e-09dadf94134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f2c4ed-f213-44bb-a52e-09dadf94134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4dd573-204d-403a-8194-089f35950c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4dd573-204d-403a-8194-089f35950c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71d9340-6dba-4375-a372-bc857b0dd9b6', 'volume_name': 'volume-d71d9340-6dba-4375-a372-bc857b0dd9b6', 'volume_size': 2}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8cdba22-b744-4ae0-aed6-ebf7d97adb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8cdba22-b744-4ae0-aed6-ebf7d97adb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06347733-427e-49ed-b85f-9e19ebf6bef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:26 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Volume d71d9340-6dba-4375-a372-bc857b0dd9b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71d9340-6dba-4375-a372-bc857b0dd9b6', 'volume_size': 2} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-611668163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71d9340-6dba-4375-a372-bc857b0dd9b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='799d1caa1d57459ea19ac27d3831b07e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:20:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:20:27Z,use_quota=True,user_id='1d37a6b9cf634ce6aa74debf52cc8d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Creating volume d71d9340-6dba-4375-a372-bc857b0dd9b6 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:20:26 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:20:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 2147483648 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:26 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 2147483648 Apr 29 19:20:26 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:27 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 2147483648" returned: 0 in 0.819s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:27 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:27 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 Apr 29 19:20:27 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:28 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6" returned: 0 in 0.603s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=81,cinder:SELECT=62,cinder:INSERT=23,cinder:DELETE=4 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06347733-427e-49ed-b85f-9e19ebf6bef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71d9340-6dba-4375-a372-bc857b0dd9b6', 'volume_size': 2}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d948bfc-dab3-4337-9830-c8a1bb6cf749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=62,cinder:INSERT=28,cinder:UPDATE=85,cinder:DELETE=8 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:20:28 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Volume volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 (d71d9340-6dba-4375-a372-bc857b0dd9b6): created successfully Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d948bfc-dab3-4337-9830-c8a1bb6cf749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:28 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Flow 'volume_create_manager' (33da24e9-563a-4c54-a32d-7d180d1f7af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:28 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-8440c8af-c294-4961-ad86-9f03271f1c39 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Created volume successfully. Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Creating offline snapshot 4bb28ba0-7991-4eba-9de8-f830fd49b146 of volume d71d9340-6dba-4375-a372-bc857b0dd9b6 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[13785888-a65a-463e-865e-f92c24259b7b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:29 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 Apr 29 19:20:29 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:29 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6" returned: 0 in 0.705s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 2G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:29 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:20:29 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:29 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 2G Apr 29 19:20:29 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:30 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.599s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:20:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:20:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:20:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:20:30 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 2G" returned: 0 in 0.737s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:30 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 Apr 29 19:20:30 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:31 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146" returned: 0 in 0.643s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:31 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 is being set with open permissions: ugo+rw Apr 29 19:20:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:31 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 Apr 29 19:20:31 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:31 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146" returned: 0 in 0.593s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:31 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.info Apr 29 19:20:31 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:32 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.info" returned: 0 in 0.617s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:32 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.info is being set with open permissions: ugo+rw Apr 29 19:20:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:32 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.info Apr 29 19:20:32 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:33 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.info" returned: 0 in 0.605s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.979s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-93e61b8a-b3e1-46f9-9f49-871d8b8d8334 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Create snapshot completed successfully Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "cinder-4bb28ba0-7991-4eba-9de8-f830fd49b146-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-4bb28ba0-7991-4eba-9de8-f830fd49b146-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "cinder-quobyte-d71d9340-6dba-4375-a372-bc857b0dd9b6" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-quobyte-d71d9340-6dba-4375-a372-bc857b0dd9b6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "cinder-quobyte-4bb28ba0-7991-4eba-9de8-f830fd49b146" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-quobyte-4bb28ba0-7991-4eba-9de8-f830fd49b146" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Deleting offline snapshot 4bb28ba0-7991-4eba-9de8-f830fd49b146 of volume d71d9340-6dba-4375-a372-bc857b0dd9b6 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] snapshot_file for this snap is: volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ca9be-f30d-4255-a09f-07c8d41a84c3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:33 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 Apr 29 19:20:33 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:34 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146" returned: 0 in 0.729s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d71d9340-6dba-4375-a372-bc857b0dd9b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:20:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a04405-f5f4-4cae-a385-0a33e8cf9924]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:34 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 Apr 29 19:20:34 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:34 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6" returned: 0 in 0.692s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:34 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 Apr 29 19:20:34 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:35 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146" returned: 0 in 0.659s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:35 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146 Apr 29 19:20:35 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:36 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6.4bb28ba0-7991-4eba-9de8-f830fd49b146" returned: 0 in 0.579s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-quobyte-4bb28ba0-7991-4eba-9de8-f830fd49b146" released by "_delete_snapshot" :: held 2.757s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-quobyte-d71d9340-6dba-4375-a372-bc857b0dd9b6" released by "delete_snapshot" :: held 2.779s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Created reservations ['90093a29-d882-4e88-9b41-ba672dcb5c51', '5bb383e7-dc89-4103-8810-be3d3a2a9e53', '7514c5a7-5183-4a66-94d2-d7d42c869de3', '734c1f00-17b7-4791-98cc-ac2d9a8c1baf'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:20:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Delete snapshot completed successfully. Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b66c5d29-1e8c-4eaf-a559-1542e4598ac1 tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-4bb28ba0-7991-4eba-9de8-f830fd49b146-delete_snapshot" released by "delete_snapshot" :: held 2.900s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "cinder-d71d9340-6dba-4375-a372-bc857b0dd9b6-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-d71d9340-6dba-4375-a372-bc857b0dd9b6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "cinder-quobyte-d71d9340-6dba-4375-a372-bc857b0dd9b6" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-quobyte-d71d9340-6dba-4375-a372-bc857b0dd9b6" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32027c3-9455-489d-b420-3e5b9cafbc76]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:36 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 Apr 29 19:20:36 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:37 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6" returned: 0 in 0.691s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:37 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6 Apr 29 19:20:37 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:37 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-d71d9340-6dba-4375-a372-bc857b0dd9b6" returned: 0 in 0.582s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-quobyte-d71d9340-6dba-4375-a372-bc857b0dd9b6" released by "delete_volume" :: held 1.333s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:37 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Created reservations ['a22a9911-f4f7-4968-8f0c-57fc88521b73', '08424413-a303-4304-97f0-6ef33d157d07', '20c6fadc-2ea7-4790-9b61-34340384a538', '5f770f11-20b8-49d3-87c8-243b18583c8a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:38 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:20:38 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:38 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.615s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:20:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Deleted volume successfully. Apr 29 19:20:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-2bfd8e0c-09fb-49b8-ab15-c5d12b78e41a tempest-VolumesSnapshotNegativeTestJSON-495969319 None] Lock "cinder-d71d9340-6dba-4375-a372-bc857b0dd9b6-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Flow 'volume_create_manager' (64143381-5bcf-4d74-81eb-8d28c0e717fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8607f32-c7fe-4af9-82e5-4c260be72039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8607f32-c7fe-4af9-82e5-4c260be72039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834fb694-ad4f-41ab-8dd6-e7cce69cad24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d52bbbaf3a34be3aefc43832752bbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:20:41Z,use_quota=True,user_id='837f1081a46148c8b71513c1b2b9845a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff40e6f5-5bde-4a9a-8408-4af2a3c63e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff40e6f5-5bde-4a9a-8408-4af2a3c63e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca32c72-8453-403a-a130-4314866935af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca32c72-8453-403a-a130-4314866935af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834fb694-ad4f-41ab-8dd6-e7cce69cad24', 'volume_name': 'volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060201f0-a5b5-4ca4-919c-849afadc8894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060201f0-a5b5-4ca4-919c-849afadc8894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219a25bf-ef1d-475c-89ce-2d2c213c73cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:41 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Volume 834fb694-ad4f-41ab-8dd6-e7cce69cad24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24', 'volume_size': 1} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834fb694-ad4f-41ab-8dd6-e7cce69cad24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d52bbbaf3a34be3aefc43832752bbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:20:41Z,use_quota=True,user_id='837f1081a46148c8b71513c1b2b9845a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Creating volume 834fb694-ad4f-41ab-8dd6-e7cce69cad24 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:20:41 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:20:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:41 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 1073741824 Apr 29 19:20:41 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:42 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 1073741824" returned: 0 in 0.740s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:42 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 Apr 29 19:20:42 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:42 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24" returned: 0 in 0.597s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219a25bf-ef1d-475c-89ce-2d2c213c73cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1100c222-4247-44aa-baa4-94ac3b9db8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:42 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Volume volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 (834fb694-ad4f-41ab-8dd6-e7cce69cad24): created successfully Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1100c222-4247-44aa-baa4-94ac3b9db8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Flow 'volume_create_manager' (64143381-5bcf-4d74-81eb-8d28c0e717fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:42 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-644809c3-e470-4b7a-851c-bb6613093a25 tempest-CinderUnicodeTest-1014539279 None] Created volume successfully. Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Flow 'volume_create_manager' (b6b41c0e-1a49-4013-b358-cdeade86dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d2015e-0a7a-4d9e-82b1-c36c184379be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d2015e-0a7a-4d9e-82b1-c36c184379be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:20:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-775847897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf0ff42-4bfc-473b-a8b8-d8d16b85e270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d52bbbaf3a34be3aefc43832752bbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:20:44Z,use_quota=True,user_id='837f1081a46148c8b71513c1b2b9845a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4345d57-af89-4b06-ab68-60354e401281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4345d57-af89-4b06-ab68-60354e401281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a80f01-bcb1-40d0-b938-5821463e26ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a80f01-bcb1-40d0-b938-5821463e26ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf0ff42-4bfc-473b-a8b8-d8d16b85e270', 'volume_name': 'volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ccca54-6ee9-430f-bda9-68e9b1d9a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ccca54-6ee9-430f-bda9-68e9b1d9a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7a1f9d-5ea6-4973-933f-d5604eb75172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:43 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Volume 6cf0ff42-4bfc-473b-a8b8-d8d16b85e270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270', 'volume_size': 1} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:20:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-775847897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf0ff42-4bfc-473b-a8b8-d8d16b85e270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d52bbbaf3a34be3aefc43832752bbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:20:44Z,use_quota=True,user_id='837f1081a46148c8b71513c1b2b9845a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Creating volume 6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:20:43 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:20:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:43 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 1073741824 Apr 29 19:20:43 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:44 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 1073741824" returned: 0 in 0.728s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:44 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 Apr 29 19:20:44 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:45 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" returned: 0 in 0.580s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:20:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7a1f9d-5ea6-4973-933f-d5604eb75172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb8eacc-8720-45bf-b312-f0e47ef4cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:20:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Volume volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 (6cf0ff42-4bfc-473b-a8b8-d8d16b85e270): created successfully Apr 29 19:20:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb8eacc-8720-45bf-b312-f0e47ef4cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:20:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Flow 'volume_create_manager' (b6b41c0e-1a49-4013-b358-cdeade86dafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:20:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f1c3e5d6-0ba0-4582-8ee5-9659a9324d13 tempest-CinderUnicodeTest-1014539279 None] Created volume successfully. Apr 29 19:20:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Creating offline snapshot c58d027d-a6d1-489e-ba57-d7707b20d92f of volume 6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:20:46 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[33196bf3-2efd-4ceb-b298-00660530be6b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:46 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 Apr 29 19:20:46 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:46 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" returned: 0 in 0.691s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:46 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f 1G Apr 29 19:20:46 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:47 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f 1G" returned: 0 in 0.708s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:47 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f Apr 29 19:20:47 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:48 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f" returned: 0 in 0.637s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:48 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f is being set with open permissions: ugo+rw Apr 29 19:20:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:48 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f Apr 29 19:20:48 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:48 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f" returned: 0 in 0.575s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:48 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.info Apr 29 19:20:48 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:49 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.info" returned: 0 in 0.584s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:49 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.info is being set with open permissions: ugo+rw Apr 29 19:20:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:49 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.info Apr 29 19:20:49 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:49 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.info" returned: 0 in 0.591s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.868s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:49 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a8e9a024-037a-465b-b33d-d07b7c67753a tempest-CinderUnicodeTest-1014539279 None] Create snapshot completed successfully Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "cinder-c58d027d-a6d1-489e-ba57-d7707b20d92f-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-c58d027d-a6d1-489e-ba57-d7707b20d92f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "cinder-quobyte-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-quobyte-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "cinder-quobyte-c58d027d-a6d1-489e-ba57-d7707b20d92f" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-quobyte-c58d027d-a6d1-489e-ba57-d7707b20d92f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Deleting offline snapshot c58d027d-a6d1-489e-ba57-d7707b20d92f of volume 6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] snapshot_file for this snap is: volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[268062bf-676e-4712-bec1-20a14bb525e8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:50 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f Apr 29 19:20:50 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:50 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f" returned: 0 in 0.697s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:50 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:20:51 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a29686-f658-4e57-b40e-7d07019e63ed]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:51 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 Apr 29 19:20:51 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:51 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" returned: 0 in 0.683s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:51 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f Apr 29 19:20:51 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:52 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f" returned: 0 in 0.651s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:52 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f Apr 29 19:20:52 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:52 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270.c58d027d-a6d1-489e-ba57-d7707b20d92f" returned: 0 in 0.578s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-quobyte-c58d027d-a6d1-489e-ba57-d7707b20d92f" released by "_delete_snapshot" :: held 2.704s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-quobyte-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" released by "delete_snapshot" :: held 2.724s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:53 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Created reservations ['7c5b0e58-3a9f-4516-bdb1-e1e497d34b25', '841c580a-b7df-457f-9e53-1889c77bf30f', '053cab50-09cf-4bd9-8035-a32238a52829', 'a39a3fc1-b3ab-4c30-9d53-f54a3ac39ac8'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:20:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Delete snapshot completed successfully. Apr 29 19:20:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-39096ba7-ed51-4e96-955f-61c9a8a793ad tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-c58d027d-a6d1-489e-ba57-d7707b20d92f-delete_snapshot" released by "delete_snapshot" :: held 2.844s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "cinder-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "cinder-quobyte-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-quobyte-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" acquired by "delete_volume" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:53 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dc8df0-b460-42b4-b41d-4e0629e87fc8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:53 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 Apr 29 19:20:53 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:54 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" returned: 0 in 0.685s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:54 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270 Apr 29 19:20:54 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:54 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" returned: 0 in 0.579s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-quobyte-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270" released by "delete_volume" :: held 1.318s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Created reservations ['bd70bded-ac1b-4835-8dc1-f0562a3c02b3', '834801cd-d89d-4f11-aec7-2be066da158f', '6460ec8d-b736-4d50-a8f0-77d7c37b2e38', 'a74c5295-9fa5-49a2-bc56-63071174d6cb'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:54 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:20:54 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:55 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.575s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:20:55 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Deleted volume successfully. Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-cce9f6d8-829b-4b72-bcf3-c126cda0b7cf tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-6cf0ff42-4bfc-473b-a8b8-d8d16b85e270-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "cinder-834fb694-ad4f-41ab-8dd6-e7cce69cad24-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-834fb694-ad4f-41ab-8dd6-e7cce69cad24-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "cinder-quobyte-834fb694-ad4f-41ab-8dd6-e7cce69cad24" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-quobyte-834fb694-ad4f-41ab-8dd6-e7cce69cad24" acquired by "delete_volume" :: waited 0.012s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad8335d-92b9-45de-9351-fa818c33780f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:20:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:55 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 Apr 29 19:20:55 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:56 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24" returned: 0 in 0.688s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:56 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24 Apr 29 19:20:56 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:57 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-834fb694-ad4f-41ab-8dd6-e7cce69cad24" returned: 0 in 0.615s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-quobyte-834fb694-ad4f-41ab-8dd6-e7cce69cad24" released by "delete_volume" :: held 1.340s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Created reservations ['2baab91e-6b3a-41a1-8c53-4bfcbb43f7f8', '4e0b293a-9a1c-4bef-846b-01e5d77ab381', '85e4c545-0b34-40d1-99dc-ad21057cd0d9', '505f33ab-c634-4717-89b3-5bda2ec9d916'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:20:57 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:20:57 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:20:57 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.572s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:20:57 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Deleted volume successfully. Apr 29 19:20:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-24a8dc9e-cee2-4415-b06a-f6e2f7c62174 tempest-CinderUnicodeTest-1014539279 None] Lock "cinder-834fb694-ad4f-41ab-8dd6-e7cce69cad24-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:07 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=44,cinder:DELETE=4,cinder:SELECT=32,cinder:INSERT=13 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:21:07 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=42,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=4 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Flow 'volume_create_manager' (6b942bc4-a5ac-4631-961d-081c95ff4f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfd8094-811c-4abf-a4b5-d56829e7d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfd8094-811c-4abf-a4b5-d56829e7d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1792448304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5354a266-57f7-472b-93eb-3b71ab3af821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90472b8ac35248febe89f8fb68451222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:16Z,use_quota=True,user_id='c3f610a12e27434999d58a1f4f54b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e039e8a6-df81-41d6-829b-1ecfeb9ffac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e039e8a6-df81-41d6-829b-1ecfeb9ffac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331acf88-5d0f-43cb-a8ba-122888317076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331acf88-5d0f-43cb-a8ba-122888317076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5354a266-57f7-472b-93eb-3b71ab3af821', 'volume_name': 'volume-5354a266-57f7-472b-93eb-3b71ab3af821', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3767a9d3-5397-4671-8304-c37cb92f7d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3767a9d3-5397-4671-8304-c37cb92f7d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a58b819-3005-4b6f-be54-d62ced1bfac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:15 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Volume 5354a266-57f7-472b-93eb-3b71ab3af821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5354a266-57f7-472b-93eb-3b71ab3af821', 'volume_size': 1} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1792448304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5354a266-57f7-472b-93eb-3b71ab3af821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90472b8ac35248febe89f8fb68451222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:16Z,use_quota=True,user_id='c3f610a12e27434999d58a1f4f54b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Creating volume 5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:21:15 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:21:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:15 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 1073741824 Apr 29 19:21:15 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:16 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 1073741824" returned: 0 in 0.792s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:16 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 Apr 29 19:21:16 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821" returned: 0 in 0.578s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:21:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:17 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a58b819-3005-4b6f-be54-d62ced1bfac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5354a266-57f7-472b-93eb-3b71ab3af821', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82a114b-cc20-4af0-8a13-a693c8c4c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:17 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Volume volume-5354a266-57f7-472b-93eb-3b71ab3af821 (5354a266-57f7-472b-93eb-3b71ab3af821): created successfully Apr 29 19:21:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82a114b-cc20-4af0-8a13-a693c8c4c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:17 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Flow 'volume_create_manager' (6b942bc4-a5ac-4631-961d-081c95ff4f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:17 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-11a72c2e-cc0d-454d-9d6f-013105535201 tempest-SnapshotDependencyTests-1294669167 None] Created volume successfully. Apr 29 19:21:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Creating offline snapshot 6085a7fa-6d02-4b16-b316-8120fded225a of volume 5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:21:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c930aa-af25-4fbc-a0f0-1e11273423c9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:21:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:18 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 Apr 29 19:21:18 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:18 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821" returned: 0 in 0.704s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:18 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a 1G Apr 29 19:21:18 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:19 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a 1G" returned: 0 in 0.728s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5354a266-57f7-472b-93eb-3b71ab3af821 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:19 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5354a266-57f7-472b-93eb-3b71ab3af821 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a Apr 29 19:21:19 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:20 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5354a266-57f7-472b-93eb-3b71ab3af821 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a" returned: 0 in 0.620s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:20 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a is being set with open permissions: ugo+rw Apr 29 19:21:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:20 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a Apr 29 19:21:20 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:20 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a" returned: 0 in 0.577s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:20 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.info Apr 29 19:21:20 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:21 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.info" returned: 0 in 0.576s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:21 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.info is being set with open permissions: ugo+rw Apr 29 19:21:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:21 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.info Apr 29 19:21:21 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:21 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.info" returned: 0 in 0.618s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.908s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:21 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-dd3807fb-12f9-4644-b6f4-f71c9e8b029a tempest-SnapshotDependencyTests-1294669167 None] Create snapshot completed successfully Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Flow 'volume_create_manager' (62cf5635-6d8f-494f-8a41-b2cb3692aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd789037-08be-4273-92d8-a4863be5d82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd789037-08be-4273-92d8-a4863be5d82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e143adf2-4ba5-4673-929f-e150e56b6a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90472b8ac35248febe89f8fb68451222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6085a7fa-6d02-4b16-b316-8120fded225a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:23Z,use_quota=True,user_id='c3f610a12e27434999d58a1f4f54b18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e908c23f-ef16-4742-943b-5660e362f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e908c23f-ef16-4742-943b-5660e362f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0135f2b-b95a-41c3-bfab-6c8c581f9820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0135f2b-b95a-41c3-bfab-6c8c581f9820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e143adf2-4ba5-4673-929f-e150e56b6a62', 'volume_name': 'volume-e143adf2-4ba5-4673-929f-e150e56b6a62', 'volume_size': 1, 'snapshot_id': '6085a7fa-6d02-4b16-b316-8120fded225a'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbd868c-7b8f-4810-9297-2bee4cb91f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbd868c-7b8f-4810-9297-2bee4cb91f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a6a0a8-c953-4f73-b324-abc118133f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:22 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Volume e143adf2-4ba5-4673-929f-e150e56b6a62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e143adf2-4ba5-4673-929f-e150e56b6a62', 'volume_size': 1, 'snapshot_id': '6085a7fa-6d02-4b16-b316-8120fded225a'} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-quobyte-6085a7fa-6d02-4b16-b316-8120fded225a-e143adf2-4ba5-4673-929f-e150e56b6a62" by "_create_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-6085a7fa-6d02-4b16-b316-8120fded225a-e143adf2-4ba5-4673-929f-e150e56b6a62" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Creating volume e143adf2-4ba5-4673-929f-e150e56b6a62 from snapshot 6085a7fa-6d02-4b16-b316-8120fded225a {{(pid=84523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-quobyte-e143adf2-4ba5-4673-929f-e150e56b6a62" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-e143adf2-4ba5-4673-929f-e150e56b6a62" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] snapshot: 6085a7fa-6d02-4b16-b316-8120fded225a, volume: e143adf2-4ba5-4673-929f-e150e56b6a62, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7623706-00bd-422f-8738-bc57d3829fb7]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:21:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:22 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a Apr 29 19:21:22 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:23 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a" returned: 0 in 0.701s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5354a266-57f7-472b-93eb-3b71ab3af821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:21:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:21:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:21:23 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e88296-1687-4a8b-a0d4-99b8d88c299e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:21:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:23 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 Apr 29 19:21:23 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:24 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821" returned: 0 in 0.693s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:24 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:21:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:24 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 Apr 29 19:21:24 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:28 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62" returned: 0 in 4.611s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:28 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[04522e08-fc1c-43ed-b4cd-2837f8d9db92]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:21:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:28 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 Apr 29 19:21:28 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:29 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821" returned: 0 in 0.859s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:29 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:21:29 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Converted 1024.00 MB image at 222.04 MB/s Apr 29 19:21:29 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 is being set with open permissions: ugo+rw Apr 29 19:21:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:29 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 Apr 29 19:21:29 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:21:29 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:21:29 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:21:30 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62" returned: 0 in 0.576s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-e143adf2-4ba5-4673-929f-e150e56b6a62" released by "_copy_volume_from_snapshot" :: held 7.525s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-6085a7fa-6d02-4b16-b316-8120fded225a-e143adf2-4ba5-4673-929f-e150e56b6a62" released by "_create_volume_from_snapshot" :: held 7.555s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.571s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a6a0a8-c953-4f73-b324-abc118133f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e143adf2-4ba5-4673-929f-e150e56b6a62', 'volume_size': 1, 'snapshot_id': '6085a7fa-6d02-4b16-b316-8120fded225a'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f984221b-7578-4b23-bbc5-6fe982166ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:30 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Volume volume-e143adf2-4ba5-4673-929f-e150e56b6a62 (e143adf2-4ba5-4673-929f-e150e56b6a62): created successfully Apr 29 19:21:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f984221b-7578-4b23-bbc5-6fe982166ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Flow 'volume_create_manager' (62cf5635-6d8f-494f-8a41-b2cb3692aab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:30 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-8bf3993f-8754-4be9-acf1-1a423c5300e7 tempest-SnapshotDependencyTests-1294669167 None] Created volume successfully. Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-6085a7fa-6d02-4b16-b316-8120fded225a-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-6085a7fa-6d02-4b16-b316-8120fded225a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-quobyte-5354a266-57f7-472b-93eb-3b71ab3af821" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-5354a266-57f7-472b-93eb-3b71ab3af821" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-quobyte-6085a7fa-6d02-4b16-b316-8120fded225a" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-6085a7fa-6d02-4b16-b316-8120fded225a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Deleting offline snapshot 6085a7fa-6d02-4b16-b316-8120fded225a of volume 5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] snapshot_file for this snap is: volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[14519707-c171-44fa-a7be-3773ab35b6b5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:21:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:31 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a Apr 29 19:21:31 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:32 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a" returned: 0 in 0.691s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5354a266-57f7-472b-93eb-3b71ab3af821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:21:32 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4ad4d2-1fe8-40ee-afc7-cceb3cf477b1]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:21:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:32 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 Apr 29 19:21:32 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:32 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821" returned: 0 in 0.709s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:32 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a Apr 29 19:21:32 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:33 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a" returned: 0 in 0.674s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:33 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a Apr 29 19:21:33 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:34 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821.6085a7fa-6d02-4b16-b316-8120fded225a" returned: 0 in 0.573s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-6085a7fa-6d02-4b16-b316-8120fded225a" released by "_delete_snapshot" :: held 2.742s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-5354a266-57f7-472b-93eb-3b71ab3af821" released by "delete_snapshot" :: held 2.763s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Created reservations ['b9afb037-6e47-4abb-b527-8bb303f0121e', 'a06c63bf-3b0a-406d-a12e-355774663eb4', '58645fa7-41c0-4818-9cb6-f4a0f5c3fe30', '8cfb14f5-72c2-4e47-8c65-dcff8d030aff'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:21:34 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Delete snapshot completed successfully. Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-b291fd70-bfd2-4233-8378-5efb11ecee7e tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-6085a7fa-6d02-4b16-b316-8120fded225a-delete_snapshot" released by "delete_snapshot" :: held 2.883s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-5354a266-57f7-472b-93eb-3b71ab3af821-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-5354a266-57f7-472b-93eb-3b71ab3af821-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-quobyte-5354a266-57f7-472b-93eb-3b71ab3af821" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-5354a266-57f7-472b-93eb-3b71ab3af821" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33139e3-96e4-4701-aa0e-68cbdc251595]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:21:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:34 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 Apr 29 19:21:34 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:35 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821" returned: 0 in 0.697s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:35 devstack sudo[92744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821 Apr 29 19:21:35 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:35 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5354a266-57f7-472b-93eb-3b71ab3af821" returned: 0 in 0.585s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-5354a266-57f7-472b-93eb-3b71ab3af821" released by "delete_volume" :: held 1.339s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:35 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Created reservations ['0f385ab5-e3ed-4a12-b507-2b56c7e772f3', '3f495c5b-05a6-4980-afbf-ba78a1138514', '552fc94e-efb4-4c90-a25d-1bacf51861e9', 'd327a86a-fa77-43a3-a22f-c6aeef37418e'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:36 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:21:36 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:36 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.585s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:21:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Deleted volume successfully. Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-254589c6-2128-44cc-a1fb-39efac5d661b tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-5354a266-57f7-472b-93eb-3b71ab3af821-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-e143adf2-4ba5-4673-929f-e150e56b6a62-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-e143adf2-4ba5-4673-929f-e150e56b6a62-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "cinder-quobyte-e143adf2-4ba5-4673-929f-e150e56b6a62" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-e143adf2-4ba5-4673-929f-e150e56b6a62" acquired by "delete_volume" :: waited 0.014s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[46856614-8010-459f-be31-62209e9a21a5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:21:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:36 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 Apr 29 19:21:36 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:37 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62" returned: 0 in 0.690s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:37 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62 Apr 29 19:21:37 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:38 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e143adf2-4ba5-4673-929f-e150e56b6a62" returned: 0 in 0.594s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-quobyte-e143adf2-4ba5-4673-929f-e150e56b6a62" released by "delete_volume" :: held 1.325s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Created reservations ['ac068299-0bca-43a8-856d-13cedc2880a7', '5fc53455-362f-45df-9dca-80c20cc00eb6', '01306012-4ed9-4578-a20f-9634234cbd93', '6d036c62-799a-4456-b637-f77ce244375c'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:38 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:21:38 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:38 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.594s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:21:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Deleted volume successfully. Apr 29 19:21:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6fde2cfd-a409-47a9-b32e-5e48a37ef738 tempest-SnapshotDependencyTests-1294669167 None] Lock "cinder-e143adf2-4ba5-4673-929f-e150e56b6a62-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:21:48 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=25,cinder:UPDATE=28,cinder:INSERT=10 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:21:48 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=23,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=4 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (f5524574-82a4-424b-b1b8-1ba3969bd77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89f69e9-6e86-4a50-8506-3e597f84cac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89f69e9-6e86-4a50-8506-3e597f84cac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1154569974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7699e425-e121-4824-99ef-78b38be6b87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9705331f-a765-4464-9e93-50a9c91d6687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9705331f-a765-4464-9e93-50a9c91d6687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20dbdf9f-a9c8-4c83-9040-c6781a30ba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20dbdf9f-a9c8-4c83-9040-c6781a30ba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7699e425-e121-4824-99ef-78b38be6b87e', 'volume_name': 'volume-7699e425-e121-4824-99ef-78b38be6b87e', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06fdb8c-8bd5-44d4-bc9f-8a803ea47085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06fdb8c-8bd5-44d4-bc9f-8a803ea47085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c054f3-5fbd-45c5-920d-d0bcae6c2c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Volume 7699e425-e121-4824-99ef-78b38be6b87e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7699e425-e121-4824-99ef-78b38be6b87e', 'volume_size': 1} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1154569974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7699e425-e121-4824-99ef-78b38be6b87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Creating volume 7699e425-e121-4824-99ef-78b38be6b87e {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:21:56 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:56 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e 1073741824 Apr 29 19:21:56 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Flow 'volume_create_manager' (9e0223ab-9a27-48ca-8f9a-d87cfa679d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313298f1-e747-4196-a1f5-5f8de5aea58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313298f1-e747-4196-a1f5-5f8de5aea58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04214444-8d9c-4a63-8bbc-458c2aa49322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7882748fa447e59b23ee212b173111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='9342c51ac3e64106b0d4643c5c161b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee03a32-55bc-48ae-a8b1-2b4a8875b18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee03a32-55bc-48ae-a8b1-2b4a8875b18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1e8665-eeae-41ef-aea8-81c9ceba9000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1e8665-eeae-41ef-aea8-81c9ceba9000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04214444-8d9c-4a63-8bbc-458c2aa49322', 'volume_name': 'volume-04214444-8d9c-4a63-8bbc-458c2aa49322', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbc8ca6-c3c6-4bb1-86b6-fa5a422956fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbc8ca6-c3c6-4bb1-86b6-fa5a422956fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0ecd26-ac08-4a2b-8428-c44c1710d672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:56 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Volume 04214444-8d9c-4a63-8bbc-458c2aa49322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04214444-8d9c-4a63-8bbc-458c2aa49322', 'volume_size': 1} Apr 29 19:21:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Flow 'volume_create_manager' (6ac0dbb9-67ce-49b8-bdfe-0e8ea5556d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da91e9f7-3ad1-4f06-b6a8-edb78f6463c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (1adce330-661f-4f40-a0f2-2c1dedcdd419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f303130f-3a10-48c2-8970-2ed7fc97f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da91e9f7-3ad1-4f06-b6a8-edb78f6463c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1659339192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cca6dd-0b09-4206-9425-2901240c7c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4417a0e454b141599f9996f7d51e178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='37f972bb443c4ded8ae55d2532c8c20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2fc459-7653-4387-a954-39b589a347ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2fc459-7653-4387-a954-39b589a347ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b0cdc6-285a-47a5-8fff-b7026bd02291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b0cdc6-285a-47a5-8fff-b7026bd02291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cca6dd-0b09-4206-9425-2901240c7c34', 'volume_name': 'volume-59cca6dd-0b09-4206-9425-2901240c7c34', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19857ad1-b29c-4d2e-ab74-5d0bd993659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19857ad1-b29c-4d2e-ab74-5d0bd993659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4906c08d-93e0-4a9d-af25-d1946851e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Volume 59cca6dd-0b09-4206-9425-2901240c7c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cca6dd-0b09-4206-9425-2901240c7c34', 'volume_size': 1} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f303130f-3a10-48c2-8970-2ed7fc97f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1796594640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e455df0-fc23-4c7c-b53c-bc85d62a9bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51cc0e2a-f06d-4da9-a786-e029da6438f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51cc0e2a-f06d-4da9-a786-e029da6438f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef2b064-84ce-463c-b7bd-fc1d4c8d061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef2b064-84ce-463c-b7bd-fc1d4c8d061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e455df0-fc23-4c7c-b53c-bc85d62a9bd0', 'volume_name': 'volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a0dbec-40ba-4c0c-b8e1-60ed38be804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a0dbec-40ba-4c0c-b8e1-60ed38be804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea13e39-4def-4b65-9f3e-c936292eb672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume 9e455df0-fc23-4c7c-b53c-bc85d62a9bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0', 'volume_size': 1} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (e868a43c-f464-44ce-95a1-ba1d44168bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308500ce-0c64-4741-b8f8-d8c15f56d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308500ce-0c64-4741-b8f8-d8c15f56d62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009183284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d18e5a6-3e9f-489f-a978-9d4e9b58a91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0631bc1b-ccc8-4fb9-a4b7-219c489f76a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0631bc1b-ccc8-4fb9-a4b7-219c489f76a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654fd2f-10c2-4387-b9e7-4a7c94ef7099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654fd2f-10c2-4387-b9e7-4a7c94ef7099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d18e5a6-3e9f-489f-a978-9d4e9b58a91c', 'volume_name': 'volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f82296a-b528-4670-a251-fb77bd9aca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f82296a-b528-4670-a251-fb77bd9aca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1496ba4-f68f-490c-9bf2-71103d5aa10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Volume 7d18e5a6-3e9f-489f-a978-9d4e9b58a91c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c', 'volume_size': 1} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:57 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e 1073741824" returned: 0 in 1.030s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:57 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e Apr 29 19:21:57 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (a1d1516f-4d43-4edb-aa1d-16436e5ad22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a49672-0664-4eb9-96c5-009aa2a77417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a49672-0664-4eb9-96c5-009aa2a77417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428482036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec76061-262f-467a-b28c-5f648a946810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:58Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb6c3ad-e2a0-46ab-9cba-bc034005e8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb6c3ad-e2a0-46ab-9cba-bc034005e8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:57 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22e63e7-23d4-4d2e-b0b6-d2c90bc821eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22e63e7-23d4-4d2e-b0b6-d2c90bc821eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec76061-262f-467a-b28c-5f648a946810', 'volume_name': 'volume-7ec76061-262f-467a-b28c-5f648a946810', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8719c9-9efd-49dd-925a-63439f6886cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8719c9-9efd-49dd-925a-63439f6886cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28390b4f-c374-4770-b548-bd42b1df7122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Volume 7ec76061-262f-467a-b28c-5f648a946810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec76061-262f-467a-b28c-5f648a946810', 'volume_size': 1} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (71bf007e-6c08-4cac-a876-93b163f32c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f81964a-97b3-4ea3-afd4-28fbea587285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f81964a-97b3-4ea3-afd4-28fbea587285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108797000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eef00a3-53f8-4cab-ac2b-6b536ad4de6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:58Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d0abd2-dee8-42b4-86f4-dfec4d00e938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d0abd2-dee8-42b4-86f4-dfec4d00e938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b26a30-3598-4da2-8f40-76d0014392cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b26a30-3598-4da2-8f40-76d0014392cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eef00a3-53f8-4cab-ac2b-6b536ad4de6e', 'volume_name': 'volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce412e6-0286-46df-b4bd-cd1922ecf469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce412e6-0286-46df-b4bd-cd1922ecf469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521a8971-dcf0-43d1-bbe8-e348c6596a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Volume 9eef00a3-53f8-4cab-ac2b-6b536ad4de6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e', 'volume_size': 1} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:58 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e" returned: 0 in 0.676s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04214444-8d9c-4a63-8bbc-458c2aa49322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7882748fa447e59b23ee212b173111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='9342c51ac3e64106b0d4643c5c161b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Creating volume 04214444-8d9c-4a63-8bbc-458c2aa49322 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:21:58 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:58 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 1073741824 Apr 29 19:21:58 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c054f3-5fbd-45c5-920d-d0bcae6c2c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7699e425-e121-4824-99ef-78b38be6b87e', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e4c89f-ae76-413f-8275-3a44e4833703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Volume volume-7699e425-e121-4824-99ef-78b38be6b87e (7699e425-e121-4824-99ef-78b38be6b87e): created successfully Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e4c89f-ae76-413f-8275-3a44e4833703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (f5524574-82a4-424b-b1b8-1ba3969bd77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:58 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-fc406187-4d8e-4a0f-b714-d38b378ad39c tempest-CreateVolumesFromImageTest-1837741067 None] Created volume successfully. Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (deeef4cd-aac3-41e4-85bb-838817aa8875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cc35af-de32-4af7-8b0a-dd2350662bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cc35af-de32-4af7-8b0a-dd2350662bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481963824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58be2c4e-0ef2-49c0-be63-7f0a7797c82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:59Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82fbf03-2430-4410-8114-2e12cd50773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82fbf03-2430-4410-8114-2e12cd50773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883ed011-ffe2-41e6-9ba0-b12ee97c63af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883ed011-ffe2-41e6-9ba0-b12ee97c63af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58be2c4e-0ef2-49c0-be63-7f0a7797c82d', 'volume_name': 'volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475f4cb4-cdda-4eac-a7da-e059d03ba673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475f4cb4-cdda-4eac-a7da-e059d03ba673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201296f5-f693-4b4a-9c7b-b512a20881f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:21:58 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Volume 58be2c4e-0ef2-49c0-be63-7f0a7797c82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d', 'volume_size': 1} Apr 29 19:21:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:21:59 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Apr 29 19:21:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 1073741824" returned: 0 in 0.844s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:21:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:21:59 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 Apr 29 19:21:59 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:00 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322" returned: 0 in 0.597s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.610s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1659339192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cca6dd-0b09-4206-9425-2901240c7c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4417a0e454b141599f9996f7d51e178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='37f972bb443c4ded8ae55d2532c8c20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Creating volume 59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:00 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:00 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 1073741824 Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0ecd26-ac08-4a2b-8428-c44c1710d672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04214444-8d9c-4a63-8bbc-458c2aa49322', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:00 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dea9a8-9e74-4b2d-a0c4-760db523fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:00 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Volume volume-04214444-8d9c-4a63-8bbc-458c2aa49322 (04214444-8d9c-4a63-8bbc-458c2aa49322): created successfully Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dea9a8-9e74-4b2d-a0c4-760db523fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Flow 'volume_create_manager' (9e0223ab-9a27-48ca-8f9a-d87cfa679d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:00 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-dd2e2ac9-acf9-420d-ae2c-46b6cb4be4d4 tempest-CinderUnicodeTest-756831566 None] Created volume successfully. Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Flow 'volume_create_manager' (10323f17-5706-48b2-9868-c21aa4e0a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d365d91d-903a-4ee1-922e-ff3518b1d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d365d91d-903a-4ee1-922e-ff3518b1d500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1335072466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610e6217-7e37-4c60-b61b-8d086f376974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7882748fa447e59b23ee212b173111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:01Z,use_quota=True,user_id='9342c51ac3e64106b0d4643c5c161b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c391d99-16e9-48fd-b51d-dc087ed6951b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c391d99-16e9-48fd-b51d-dc087ed6951b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882c783b-6967-40fa-9a54-282a5301abb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882c783b-6967-40fa-9a54-282a5301abb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610e6217-7e37-4c60-b61b-8d086f376974', 'volume_name': 'volume-610e6217-7e37-4c60-b61b-8d086f376974', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d159f15b-aab5-4a78-a8ce-0a63de8cef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d159f15b-aab5-4a78-a8ce-0a63de8cef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b202f2-f041-4786-9420-b18ab7b859cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:00 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Volume 610e6217-7e37-4c60-b61b-8d086f376974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610e6217-7e37-4c60-b61b-8d086f376974', 'volume_size': 1} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:00 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 1073741824" returned: 0 in 0.891s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:01 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 Apr 29 19:22:01 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:01 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34" returned: 0 in 0.613s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.095s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1796594640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e455df0-fc23-4c7c-b53c-bc85d62a9bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Creating volume 9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:01 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:01 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 1073741824 Apr 29 19:22:01 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4906c08d-93e0-4a9d-af25-d1946851e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cca6dd-0b09-4206-9425-2901240c7c34', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b4483d-5ec7-4b15-a531-70b38f98a276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:01 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Volume volume-59cca6dd-0b09-4206-9425-2901240c7c34 (59cca6dd-0b09-4206-9425-2901240c7c34): created successfully Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b4483d-5ec7-4b15-a531-70b38f98a276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:01 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Flow 'volume_create_manager' (6ac0dbb9-67ce-49b8-bdfe-0e8ea5556d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d749d3c4-ac89-42d3-aede-6ffac9b2d07a tempest-VolumeDependencyTests-1145165108 None] Created volume successfully. Apr 29 19:22:02 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 1073741824" returned: 0 in 0.782s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:02 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 Apr 29 19:22:02 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:03 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" returned: 0 in 0.617s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.424s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009183284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d18e5a6-3e9f-489f-a978-9d4e9b58a91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:57Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Creating volume 7d18e5a6-3e9f-489f-a978-9d4e9b58a91c {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:03 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:03 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c 1073741824 Apr 29 19:22:03 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea13e39-4def-4b65-9f3e-c936292eb672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01be3304-245c-41c8-a231-f0cb113ff37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:03 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 (9e455df0-fc23-4c7c-b53c-bc85d62a9bd0): created successfully Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01be3304-245c-41c8-a231-f0cb113ff37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (1adce330-661f-4f40-a0f2-2c1dedcdd419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:03 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3ef6cb1a-2278-4502-9c02-642b9df4a908 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created volume successfully. Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:03 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c 1073741824" returned: 0 in 0.853s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:03 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c Apr 29 19:22:03 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:04 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c" returned: 0 in 0.591s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.521s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428482036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec76061-262f-467a-b28c-5f648a946810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:58Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Creating volume 7ec76061-262f-467a-b28c-5f648a946810 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:04 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:04 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 1073741824 Apr 29 19:22:04 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1496ba4-f68f-490c-9bf2-71103d5aa10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f8b878-33dd-4c33-bbef-3188597b8754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:04 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Volume volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c (7d18e5a6-3e9f-489f-a978-9d4e9b58a91c): created successfully Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f8b878-33dd-4c33-bbef-3188597b8754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:04 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (e868a43c-f464-44ce-95a1-ba1d44168bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:04 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-a4e53e82-3712-499d-bbc4-95702722b844 tempest-CreateVolumesFromImageTest-1837741067 None] Created volume successfully. Apr 29 19:22:05 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 1073741824" returned: 0 in 0.782s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:05 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 Apr 29 19:22:05 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:05 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810" returned: 0 in 0.598s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.571s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108797000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eef00a3-53f8-4cab-ac2b-6b536ad4de6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:58Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Creating volume 9eef00a3-53f8-4cab-ac2b-6b536ad4de6e {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:05 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:06 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e 1073741824 Apr 29 19:22:06 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28390b4f-c374-4770-b548-bd42b1df7122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec76061-262f-467a-b28c-5f648a946810', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddba95e-4a50-43d4-890f-e7b2a59ca8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:06 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Volume volume-7ec76061-262f-467a-b28c-5f648a946810 (7ec76061-262f-467a-b28c-5f648a946810): created successfully Apr 29 19:22:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddba95e-4a50-43d4-890f-e7b2a59ca8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:06 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (a1d1516f-4d43-4edb-aa1d-16436e5ad22f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:06 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-293970a6-cb32-41ce-86f6-e49fc550b4d9 tempest-CreateVolumesFromImageTest-1837741067 None] Created volume successfully. Apr 29 19:22:06 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e 1073741824" returned: 0 in 0.808s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:06 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:06 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e Apr 29 19:22:06 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:07 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e" returned: 0 in 0.598s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.625s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481963824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58be2c4e-0ef2-49c0-be63-7f0a7797c82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ff0bbeec834b749564527af0a22460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:21:59Z,use_quota=True,user_id='9c3fae8c21114de39e81121f1b01d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Creating volume 58be2c4e-0ef2-49c0-be63-7f0a7797c82d {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:07 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521a8971-dcf0-43d1-bbe8-e348c6596a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a79c38-1409-4985-afae-fff369112219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:07 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d 1073741824 Apr 29 19:22:07 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:07 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Volume volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e (9eef00a3-53f8-4cab-ac2b-6b536ad4de6e): created successfully Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a79c38-1409-4985-afae-fff369112219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:07 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (71bf007e-6c08-4cac-a876-93b163f32c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:07 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e7352e84-2d49-44cd-ac99-d709844c53cc tempest-CreateVolumesFromImageTest-1837741067 None] Created volume successfully. Apr 29 19:22:08 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d 1073741824" returned: 0 in 0.769s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:08 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d Apr 29 19:22:08 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:08 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d" returned: 0 in 0.579s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.932s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1335072466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610e6217-7e37-4c60-b61b-8d086f376974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7882748fa447e59b23ee212b173111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:01Z,use_quota=True,user_id='9342c51ac3e64106b0d4643c5c161b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Creating volume 610e6217-7e37-4c60-b61b-8d086f376974 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:08 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201296f5-f693-4b4a-9c7b-b512a20881f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:08 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 1073741824 Apr 29 19:22:08 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce049aa6-00ad-4682-864a-a1206ca4e19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:08 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Volume volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d (58be2c4e-0ef2-49c0-be63-7f0a7797c82d): created successfully Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce049aa6-00ad-4682-864a-a1206ca4e19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:08 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Flow 'volume_create_manager' (deeef4cd-aac3-41e4-85bb-838817aa8875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:08 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-98f5fc11-c799-4314-91ae-505d5ad6a300 tempest-CreateVolumesFromImageTest-1837741067 None] Created volume successfully. Apr 29 19:22:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-58be2c4e-0ef2-49c0-be63-7f0a7797c82d-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-58be2c4e-0ef2-49c0-be63-7f0a7797c82d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:09 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 1073741824" returned: 0 in 0.788s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-quobyte-58be2c4e-0ef2-49c0-be63-7f0a7797c82d" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-58be2c4e-0ef2-49c0-be63-7f0a7797c82d" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:09 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f692161-2a49-46c0-bec1-71192f6b2715]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:09 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 Apr 29 19:22:09 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:09 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d Apr 29 19:22:09 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:10 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974" returned: 0 in 0.599s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.449s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b202f2-f041-4786-9420-b18ab7b859cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610e6217-7e37-4c60-b61b-8d086f376974', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0413b5d9-cb7a-487c-bed3-bb9a723e6eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Creating offline snapshot 280b3124-2576-4bba-989b-811dc5675452 of volume 59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:22:10 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Volume volume-610e6217-7e37-4c60-b61b-8d086f376974 (610e6217-7e37-4c60-b61b-8d086f376974): created successfully Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0413b5d9-cb7a-487c-bed3-bb9a723e6eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Flow 'volume_create_manager' (10323f17-5706-48b2-9868-c21aa4e0a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d883e6-8009-4487-bdbc-99d4d511d550]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-2be43713-51ed-4cc4-b1b5-d4953e440546 tempest-CinderUnicodeTest-756831566 None] Created volume successfully. Apr 29 19:22:10 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d" returned: 0 in 0.727s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:10 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d Apr 29 19:22:10 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:10 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 Apr 29 19:22:10 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:11 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-58be2c4e-0ef2-49c0-be63-7f0a7797c82d" returned: 0 in 0.621s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-58be2c4e-0ef2-49c0-be63-7f0a7797c82d" released by "delete_volume" :: held 1.403s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Created reservations ['e0a2b91b-c5f6-45af-bfea-c0c6c5804036', 'b7664e1f-7dd3-448b-8b48-78188133aa61', '86c714d8-786f-4283-9c75-f2acd4d0269d', '0a8f19c7-0493-48f4-b942-e997aa84caf3'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:11 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34" returned: 0 in 0.785s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:11 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 1G Apr 29 19:22:11 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:11 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:11 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:11 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.688s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-quobyte-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:11 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Deleted volume successfully. Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e" acquired by "delete_volume" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e242639-3acd-45c9-aa97-9dc5e34540b4 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-58be2c4e-0ef2-49c0-be63-7f0a7797c82d-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ac520-e8d9-4383-a991-1c909f1475ca]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:12 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 1G" returned: 0 in 0.919s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cca6dd-0b09-4206-9425-2901240c7c34 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:12 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e Apr 29 19:22:12 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:12 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cca6dd-0b09-4206-9425-2901240c7c34 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 Apr 29 19:22:12 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:12 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e" returned: 0 in 0.732s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:12 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e Apr 29 19:22:12 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:12 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cca6dd-0b09-4206-9425-2901240c7c34 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452" returned: 0 in 0.694s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:12 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 is being set with open permissions: ugo+rw Apr 29 19:22:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:12 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 Apr 29 19:22:12 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:13 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e" returned: 0 in 0.631s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e" released by "delete_volume" :: held 1.403s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Created reservations ['59c153c4-2f35-4d36-899e-937d24d47f09', 'c7a38c02-3c6b-4168-97b7-1a13304fa0bf', '44428427-ea0b-4967-bf2f-1d537007de60', '019688a0-cb81-48dd-a9d9-52da5b19f38c'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:13 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452" returned: 0 in 0.624s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:13 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.info Apr 29 19:22:13 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:13 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:13 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:14 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.info" returned: 0 in 0.619s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:14 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.info is being set with open permissions: ugo+rw Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-7ec76061-262f-467a-b28c-5f648a946810-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:14 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.642s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:14 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.info Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:14 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-7ec76061-262f-467a-b28c-5f648a946810-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:14 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Deleted volume successfully. Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-6cae066e-8b9f-442f-af21-d611008a518b tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-9eef00a3-53f8-4cab-ac2b-6b536ad4de6e-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-quobyte-7ec76061-262f-467a-b28c-5f648a946810" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-7ec76061-262f-467a-b28c-5f648a946810" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9063cfa-b624-4124-9c58-575bda4d49d8]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:14 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 Apr 29 19:22:14 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:14 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.info" returned: 0 in 0.659s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.421s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.943s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Creating offline snapshot 0e404f7b-4f71-41d2-be91-1fa2d917efb6 of volume 9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:22:14 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-03f123f9-a605-458d-a453-08d3026fceed tempest-VolumeDependencyTests-1145165108 None] Create snapshot completed successfully Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62e6037-a11c-4de0-a72b-a86c6114d9e0]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:14 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 Apr 29 19:22:14 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:14 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810" returned: 0 in 0.734s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:14 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810 Apr 29 19:22:14 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:15 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" returned: 0 in 0.759s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:15 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7ec76061-262f-467a-b28c-5f648a946810" returned: 0 in 0.640s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:15 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 1G Apr 29 19:22:15 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-7ec76061-262f-467a-b28c-5f648a946810" released by "delete_volume" :: held 1.423s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Created reservations ['1eb64171-b87a-48e1-a0b0-9344d94bf271', '08a8f504-bc68-4692-91d8-aee6838116ca', '9466a90e-2813-4e84-8c8a-418ca4351e4a', '2ab2e6b5-b237-4fae-a6e7-440c163b8e00'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:15 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:15 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Flow 'volume_create_manager' (68ca0ab4-fd80-4e7a-978f-c2484889c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1081c33-5d80-43ba-9c80-e8d1574681a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1081c33-5d80-43ba-9c80-e8d1574681a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-314243758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7cf045-70bd-4da0-ab37-78415abc8936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4417a0e454b141599f9996f7d51e178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=280b3124-2576-4bba-989b-811dc5675452,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:16Z,use_quota=True,user_id='37f972bb443c4ded8ae55d2532c8c20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a91e476-9458-42a3-bb0f-f557a6aac782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a91e476-9458-42a3-bb0f-f557a6aac782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0bc5c6-4363-42d2-9bfd-00e022006cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0bc5c6-4363-42d2-9bfd-00e022006cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f7cf045-70bd-4da0-ab37-78415abc8936', 'volume_name': 'volume-9f7cf045-70bd-4da0-ab37-78415abc8936', 'volume_size': 1, 'snapshot_id': '280b3124-2576-4bba-989b-811dc5675452'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1c0e6e-5a5a-4100-ae14-10d74b3251fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1c0e6e-5a5a-4100-ae14-10d74b3251fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865bb5eb-d239-4770-9bcb-4807534563d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:15 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Volume 9f7cf045-70bd-4da0-ab37-78415abc8936: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f7cf045-70bd-4da0-ab37-78415abc8936', 'volume_size': 1, 'snapshot_id': '280b3124-2576-4bba-989b-811dc5675452'} Apr 29 19:22:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-quobyte-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:16 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:16 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.653s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:16 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Deleted volume successfully. Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c" acquired by "delete_volume" :: waited 0.040s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 1G" returned: 0 in 0.912s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6493e2-f3ef-4713-811d-15c8f0a2b6d5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:16 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 Apr 29 19:22:16 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-aaa95e9c-dc78-4bf1-a186-1fb28b2613a0 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-7ec76061-262f-467a-b28c-5f648a946810-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:16 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c Apr 29 19:22:16 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:17 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6" returned: 0 in 0.688s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:17 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 is being set with open permissions: ugo+rw Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:17 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 Apr 29 19:22:17 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:17 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c" returned: 0 in 0.749s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:17 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c Apr 29 19:22:17 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:17 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6" returned: 0 in 0.646s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:17 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.info Apr 29 19:22:17 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:17 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c" returned: 0 in 0.633s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c" released by "delete_volume" :: held 1.439s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Created reservations ['8cc1da4f-bf37-4bc6-bb81-ddfc0702e906', '154a242b-9e04-4bfe-aba3-be33d29d01ad', '69dce88b-fb1b-4fde-a438-69399a2256f2', 'c3f322af-104b-4a59-a7e9-642042a09ba6'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:17 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:17 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:18 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.info" returned: 0 in 0.628s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:18 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.info is being set with open permissions: ugo+rw Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:18 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.info Apr 29 19:22:18 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:18 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.606s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-7699e425-e121-4824-99ef-78b38be6b87e-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Deleted volume successfully. Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-7699e425-e121-4824-99ef-78b38be6b87e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0b87fc5b-5fbf-41dc-b362-c7910c14ea24 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-7d18e5a6-3e9f-489f-a978-9d4e9b58a91c-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "cinder-quobyte-7699e425-e121-4824-99ef-78b38be6b87e" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-7699e425-e121-4824-99ef-78b38be6b87e" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[735ebab0-522b-4c47-9ba4-e168173c5047]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:18 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e Apr 29 19:22:18 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:19 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.info" returned: 0 in 0.645s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.381s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.481s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Creating offline snapshot 1526bf51-5520-4847-84c6-99315c501823 of volume 610e6217-7e37-4c60-b61b-8d086f376974 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:22:19 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7300e8e7-2d5e-4920-a7f2-8feed24ab6de tempest-CreateVolumesFromSnapshotTest-1416597810 None] Create snapshot completed successfully Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f42b84-f9c5-4d6b-8554-c5718a912624]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:19 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 Apr 29 19:22:19 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:19 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e" returned: 0 in 0.754s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:19 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e Apr 29 19:22:19 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (e1180614-026c-4653-b291-8f92a8fcaad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720cfef3-bbe4-4849-b84d-06250f5e1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720cfef3-bbe4-4849-b84d-06250f5e1037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-605215745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ae2b86-415f-43f9-a6f1-c4e793a03706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:20Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69068c7-1a06-4604-92a6-bdb7c9c806fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69068c7-1a06-4604-92a6-bdb7c9c806fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2f750a-4239-43ad-b1db-f4ccee07ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2f750a-4239-43ad-b1db-f4ccee07ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1ae2b86-415f-43f9-a6f1-c4e793a03706', 'volume_name': 'volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4324973-7320-4c78-b680-6738473563dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4324973-7320-4c78-b680-6738473563dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a13946-f3cf-4633-8898-f89516ebfe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:19 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume f1ae2b86-415f-43f9-a6f1-c4e793a03706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706', 'volume_size': 1} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:19 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974" returned: 0 in 0.853s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:20 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 1G Apr 29 19:22:20 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (273bfb67-cba8-4653-9398-c27b0bf86044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:20 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b44e486-16d1-490f-a930-4e9aba2cae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7699e425-e121-4824-99ef-78b38be6b87e" returned: 0 in 0.726s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b44e486-16d1-490f-a930-4e9aba2cae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034378898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f54677-6092-4960-9c5f-c13faf62f8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:20Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3c249c-3143-4f66-b69e-3399f99e1841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3c249c-3143-4f66-b69e-3399f99e1841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11491d62-a603-4514-ab3a-ddab3054f862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11491d62-a603-4514-ab3a-ddab3054f862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f54677-6092-4960-9c5f-c13faf62f8e8', 'volume_name': 'volume-57f54677-6092-4960-9c5f-c13faf62f8e8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba5ed64-a799-4c3c-97bd-9f6ea10ff31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba5ed64-a799-4c3c-97bd-9f6ea10ff31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21c358a-2806-4f35-a3a0-d01395f70eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume 57f54677-6092-4960-9c5f-c13faf62f8e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f54677-6092-4960-9c5f-c13faf62f8e8', 'volume_size': 1} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-quobyte-7699e425-e121-4824-99ef-78b38be6b87e" released by "delete_volume" :: held 1.572s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Created reservations ['12897122-b54b-439e-b0cb-c83391c76632', '814bba2b-ba37-4fa8-bb1c-7d90056fc502', '44cf3448-8427-4878-8b68-0dcff25e0539', 'c86e3c3d-18cf-4d72-8006-8eb3fb09e62e'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:20 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:20 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (26cf68a1-d48d-4f87-94cd-043d845ba28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0eb9b4-ffce-480d-99dd-e2666fcaa0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0eb9b4-ffce-480d-99dd-e2666fcaa0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215293527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:20Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd23411c-72ab-4776-8cbf-99ad12a93ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd23411c-72ab-4776-8cbf-99ad12a93ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f1e8ad-0e95-4c33-bea8-5a37d706cb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f1e8ad-0e95-4c33-bea8-5a37d706cb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a', 'volume_name': 'volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e9c2c6-54e5-4f1c-8da7-7cfa28101c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e9c2c6-54e5-4f1c-8da7-7cfa28101c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e081d67-c8ca-4acb-8a54-808d1cc670f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:20 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume 3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a', 'volume_size': 1} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:20 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (bd26546a-bf48-4742-971a-4c0ddd436ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b188692-44b4-49dd-aa37-3e99aee728b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b188692-44b4-49dd-aa37-3e99aee728b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1009402690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9da95fa-4d07-4610-88a2-37c65207bd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:21Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b48dc3-8ff0-48ac-8c31-1a2a0bd9f0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b48dc3-8ff0-48ac-8c31-1a2a0bd9f0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632ab875-49d0-4087-89eb-76267cb28dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632ab875-49d0-4087-89eb-76267cb28dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9da95fa-4d07-4610-88a2-37c65207bd53', 'volume_name': 'volume-b9da95fa-4d07-4610-88a2-37c65207bd53', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6003987-2c5e-40ce-8882-73bf33edfeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6003987-2c5e-40ce-8882-73bf33edfeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a03b41-6ef1-4ab8-b9f3-fde3c6d264d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume b9da95fa-4d07-4610-88a2-37c65207bd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9da95fa-4d07-4610-88a2-37c65207bd53', 'volume_size': 1} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 1G" returned: 0 in 1.145s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-610e6217-7e37-4c60-b61b-8d086f376974 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:21 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-610e6217-7e37-4c60-b61b-8d086f376974 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 Apr 29 19:22:21 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:21 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.816s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:21 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Deleted volume successfully. Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-03ae1898-1424-4726-bc83-61ff9177ba18 tempest-CreateVolumesFromImageTest-1837741067 None] Lock "cinder-7699e425-e121-4824-99ef-78b38be6b87e-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (06668e85-a9ee-4bf8-811f-18ea6389df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d695376f-bf83-4ff2-8247-3b2f9d550810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d695376f-bf83-4ff2-8247-3b2f9d550810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-666500494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff8285a-b1d0-4806-8522-0ef58ed5d2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:21Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887e0f69-0c4b-4881-8f9d-fcc3cca3bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887e0f69-0c4b-4881-8f9d-fcc3cca3bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebe5ca7-a645-4823-b862-af8a26b0de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebe5ca7-a645-4823-b862-af8a26b0de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff8285a-b1d0-4806-8522-0ef58ed5d2d4', 'volume_name': 'volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059ccef2-0405-4cd4-bd48-437bcb20a6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059ccef2-0405-4cd4-bd48-437bcb20a6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72a92d8-f9de-4034-b00b-f095a7fe55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:21 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume 2ff8285a-b1d0-4806-8522-0ef58ed5d2d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4', 'volume_size': 1} Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:21 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-610e6217-7e37-4c60-b61b-8d086f376974 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823" returned: 0 in 0.754s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:21 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 is being set with open permissions: ugo+rw Apr 29 19:22:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:21 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 Apr 29 19:22:21 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:22 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823" returned: 0 in 0.597s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:22 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.info Apr 29 19:22:22 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:23 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.info" returned: 0 in 0.642s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:23 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.info is being set with open permissions: ugo+rw Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:23 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.info Apr 29 19:22:23 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:23 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.info" returned: 0 in 0.638s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.748s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.951s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-280b3124-2576-4bba-989b-811dc5675452-9f7cf045-70bd-4da0-ab37-78415abc8936" by "_create_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-280b3124-2576-4bba-989b-811dc5675452-9f7cf045-70bd-4da0-ab37-78415abc8936" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Creating volume 9f7cf045-70bd-4da0-ab37-78415abc8936 from snapshot 280b3124-2576-4bba-989b-811dc5675452 {{(pid=84523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-9f7cf045-70bd-4da0-ab37-78415abc8936" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-9f7cf045-70bd-4da0-ab37-78415abc8936" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] snapshot: 280b3124-2576-4bba-989b-811dc5675452, volume: 9f7cf045-70bd-4da0-ab37-78415abc8936, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:22:23 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-fcc748ab-a1f5-4298-89d8-c30979e9b6ea tempest-CinderUnicodeTest-756831566 None] Create snapshot completed successfully Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (acdf99af-c02f-4840-82d9-a24e2e4c7cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9ffe7b-d6bc-42e8-8614-b5b79d2ebad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[52373e56-9f94-4163-bfe7-bfa63efb48a3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9ffe7b-d6bc-42e8-8614-b5b79d2ebad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1472140051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2163d8-ca69-449c-85df-22355976e5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:24Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6159b6-b5c5-4f6e-b5ea-522d846f7507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6159b6-b5c5-4f6e-b5ea-522d846f7507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483ebc30-621b-4401-b599-c7e5f62b03c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483ebc30-621b-4401-b599-c7e5f62b03c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2163d8-ca69-449c-85df-22355976e5f2', 'volume_name': 'volume-7d2163d8-ca69-449c-85df-22355976e5f2', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0fa14a-0aec-48fd-8f5b-95a776224299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0fa14a-0aec-48fd-8f5b-95a776224299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ddbd7f-4757-4db4-b740-cce63d715f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:24 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume 7d2163d8-ca69-449c-85df-22355976e5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2163d8-ca69-449c-85df-22355976e5f2', 'volume_size': 1} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:24 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 Apr 29 19:22:24 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Acquiring lock "cinder-1526bf51-5520-4847-84c6-99315c501823-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Lock "cinder-1526bf51-5520-4847-84c6-99315c501823-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Acquiring lock "cinder-quobyte-610e6217-7e37-4c60-b61b-8d086f376974" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Lock "cinder-quobyte-610e6217-7e37-4c60-b61b-8d086f376974" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Acquiring lock "cinder-quobyte-1526bf51-5520-4847-84c6-99315c501823" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Lock "cinder-quobyte-1526bf51-5520-4847-84c6-99315c501823" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Deleting offline snapshot 1526bf51-5520-4847-84c6-99315c501823 of volume 610e6217-7e37-4c60-b61b-8d086f376974 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] snapshot_file for this snap is: volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d733be07-cc72-4bf7-8356-4df70d1decdb]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:24 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 Apr 29 19:22:24 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:24 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452" returned: 0 in 0.752s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59cca6dd-0b09-4206-9425-2901240c7c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4dde96-03dc-41a0-982c-c80437449690]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:24 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:24 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 Apr 29 19:22:24 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:25 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823" returned: 0 in 0.744s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-610e6217-7e37-4c60-b61b-8d086f376974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b6989b-d4e6-4a4b-add8-1ae222132b42]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:25 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 Apr 29 19:22:25 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:25 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34" returned: 0 in 0.727s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:25 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 Apr 29 19:22:25 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:25 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974" returned: 0 in 0.711s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:25 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:25 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 Apr 29 19:22:25 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:26 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823" returned: 0 in 0.996s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:26 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:26 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823 Apr 29 19:22:26 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:28 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974.1526bf51-5520-4847-84c6-99315c501823" returned: 0 in 1.499s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Lock "cinder-quobyte-1526bf51-5520-4847-84c6-99315c501823" released by "_delete_snapshot" :: held 4.154s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Lock "cinder-quobyte-610e6217-7e37-4c60-b61b-8d086f376974" released by "delete_snapshot" :: held 4.181s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:28 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Created reservations ['4f398010-ce12-45b9-88cf-779391cff439', 'f754de7d-74cf-419b-a35a-f57e1e30055c', '29f75d49-038a-4014-a469-44b17fb41798', '3cbfe447-1d4c-4d3a-b911-ce70cc9f538b'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:28 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Delete snapshot completed successfully. Apr 29 19:22:28 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1cbda42e-28e1-492a-9f15-53660865747a tempest-CinderUnicodeTest-756831566 None] Lock "cinder-1526bf51-5520-4847-84c6-99315c501823-delete_snapshot" released by "delete_snapshot" :: held 4.585s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Acquiring lock "cinder-610e6217-7e37-4c60-b61b-8d086f376974-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:29 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:29 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Lock "cinder-610e6217-7e37-4c60-b61b-8d086f376974-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Acquiring lock "cinder-quobyte-610e6217-7e37-4c60-b61b-8d086f376974" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Lock "cinder-quobyte-610e6217-7e37-4c60-b61b-8d086f376974" acquired by "delete_volume" :: waited 0.039s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[379b1a3a-8500-4301-a557-56a04610f370]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:30 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 Apr 29 19:22:30 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:30 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.167s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:22:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:22:31 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936" returned: 0 in 5.591s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:31 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2718cb6-442a-40f9-aec0-469f09433b7b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:31 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 Apr 29 19:22:31 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:31 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974" returned: 0 in 1.176s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:31 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974 Apr 29 19:22:31 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:32 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34" returned: 0 in 0.920s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:22:32 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Converted 1024.00 MB image at 183.12 MB/s Apr 29 19:22:32 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 is being set with open permissions: ugo+rw Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:32 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 Apr 29 19:22:32 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:32 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-610e6217-7e37-4c60-b61b-8d086f376974" returned: 0 in 0.607s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Lock "cinder-quobyte-610e6217-7e37-4c60-b61b-8d086f376974" released by "delete_volume" :: held 1.943s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Created reservations ['8df46049-37a3-48dc-bc8b-ed0c59a3a52d', 'a33b071d-de71-472e-9729-3f87319d81a6', 'aeccd00f-bb4c-44e9-ab5c-13ba198f197f', '74ab38f2-e30c-4047-b309-6c4d35c6a4b2'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:32 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:32 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:32 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936" returned: 0 in 0.634s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-9f7cf045-70bd-4da0-ab37-78415abc8936" released by "_copy_volume_from_snapshot" :: held 8.756s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-280b3124-2576-4bba-989b-811dc5675452-9f7cf045-70bd-4da0-ab37-78415abc8936" released by "_create_volume_from_snapshot" :: held 8.801s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.827s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.736s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-605215745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ae2b86-415f-43f9-a6f1-c4e793a03706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:20Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Creating volume f1ae2b86-415f-43f9-a6f1-c4e793a03706 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:32 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:32 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 1073741824 Apr 29 19:22:32 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865bb5eb-d239-4770-9bcb-4807534563d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7cf045-70bd-4da0-ab37-78415abc8936', 'volume_size': 1, 'snapshot_id': '280b3124-2576-4bba-989b-811dc5675452'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20c5ede-f6ce-478b-90c2-93b48ced5835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:32 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Volume volume-9f7cf045-70bd-4da0-ab37-78415abc8936 (9f7cf045-70bd-4da0-ab37-78415abc8936): created successfully Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20c5ede-f6ce-478b-90c2-93b48ced5835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Flow 'volume_create_manager' (68ca0ab4-fd80-4e7a-978f-c2484889c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:32 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9aec2452-95a9-4298-a159-9c337a34eb76 tempest-VolumeDependencyTests-1145165108 None] Created volume successfully. Apr 29 19:22:32 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.619s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:32 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Deleted volume successfully. Apr 29 19:22:32 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-258cdac4-d6e4-4e9f-ab99-254379ee245e tempest-CinderUnicodeTest-756831566 None] Lock "cinder-610e6217-7e37-4c60-b61b-8d086f376974-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Acquiring lock "cinder-04214444-8d9c-4a63-8bbc-458c2aa49322-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Lock "cinder-04214444-8d9c-4a63-8bbc-458c2aa49322-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Acquiring lock "cinder-quobyte-04214444-8d9c-4a63-8bbc-458c2aa49322" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Lock "cinder-quobyte-04214444-8d9c-4a63-8bbc-458c2aa49322" acquired by "delete_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-280b3124-2576-4bba-989b-811dc5675452-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab89511-7205-4463-940c-a0d330695552]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-280b3124-2576-4bba-989b-811dc5675452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-59cca6dd-0b09-4206-9425-2901240c7c34" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-59cca6dd-0b09-4206-9425-2901240c7c34" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-280b3124-2576-4bba-989b-811dc5675452" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-280b3124-2576-4bba-989b-811dc5675452" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Deleting offline snapshot 280b3124-2576-4bba-989b-811dc5675452 of volume 59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] snapshot_file for this snap is: volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[56145e69-46ba-4933-b8da-eeda94e0a446]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:33 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 1073741824" returned: 0 in 0.900s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:33 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 Apr 29 19:22:33 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:33 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 Apr 29 19:22:33 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:33 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 Apr 29 19:22:33 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:34 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322" returned: 0 in 0.755s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:34 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706" returned: 0 in 0.616s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.003s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034378898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f54677-6092-4960-9c5f-c13faf62f8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:20Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Creating volume 57f54677-6092-4960-9c5f-c13faf62f8e8 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:34 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322 Apr 29 19:22:34 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:34 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a13946-f3cf-4633-8898-f89516ebfe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:34 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 1073741824 Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294f61f4-a7f0-47d2-bba0-a9ab9b13f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:34 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:34 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 (f1ae2b86-415f-43f9-a6f1-c4e793a03706): created successfully Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294f61f4-a7f0-47d2-bba0-a9ab9b13f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (e1180614-026c-4653-b291-8f92a8fcaad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:34 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7ffeec80-8974-445f-be6a-839fdae3564b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created volume successfully. Apr 29 19:22:34 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452" returned: 0 in 0.794s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59cca6dd-0b09-4206-9425-2901240c7c34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b65540-803c-473a-98a6-7d7614de3852]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:34 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 Apr 29 19:22:34 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:34 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-04214444-8d9c-4a63-8bbc-458c2aa49322" returned: 0 in 0.652s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Lock "cinder-quobyte-04214444-8d9c-4a63-8bbc-458c2aa49322" released by "delete_volume" :: held 1.464s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:34 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Created reservations ['eb3471fe-7aef-4dd4-9170-bf4359b9d40c', '0e7ab64d-2b72-4d63-9852-289c818b0163', 'abc4fd0c-195c-44b2-a6cc-59f7f7242639', '6c9d2345-39e0-49f2-b409-7cc999d43e53'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:35 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:35 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:35 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 1073741824" returned: 0 in 0.882s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:35 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34" returned: 0 in 0.793s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:35 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 Apr 29 19:22:35 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:35 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 Apr 29 19:22:35 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:35 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.648s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:35 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Deleted volume successfully. Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-57723095-9b69-45ab-8e93-f8073ede3049 tempest-CinderUnicodeTest-756831566 None] Lock "cinder-04214444-8d9c-4a63-8bbc-458c2aa49322-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:35 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8" returned: 0 in 0.657s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.241s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215293527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:20Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Creating volume 3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:35 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:35 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a 1073741824 Apr 29 19:22:35 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21c358a-2806-4f35-a3a0-d01395f70eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f54677-6092-4960-9c5f-c13faf62f8e8', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab8d9b6-285a-448f-9ff6-6a38f087dc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:35 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume volume-57f54677-6092-4960-9c5f-c13faf62f8e8 (57f54677-6092-4960-9c5f-c13faf62f8e8): created successfully Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab8d9b6-285a-448f-9ff6-6a38f087dc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:35 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (273bfb67-cba8-4653-9398-c27b0bf86044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:35 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3918e1a7-907e-43f4-b2a8-ee2e9c8b92fb tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created volume successfully. Apr 29 19:22:36 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452" returned: 0 in 0.832s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:36 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452 Apr 29 19:22:36 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:36 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a 1073741824" returned: 0 in 0.838s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:36 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34.280b3124-2576-4bba-989b-811dc5675452" returned: 0 in 0.721s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:36 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a Apr 29 19:22:36 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-280b3124-2576-4bba-989b-811dc5675452" released by "_delete_snapshot" :: held 3.268s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-59cca6dd-0b09-4206-9425-2901240c7c34" released by "delete_snapshot" :: held 3.303s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Created reservations ['e61d6f31-df6a-4e5b-af83-d92b171e5ea0', 'c91ff986-aade-4194-9cea-5527291f05cf', '8204dbb4-ff33-4da7-b0f8-6ccc16657e48', '54ea9956-5ee8-40ee-b982-87c6458d89d4'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:36 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Delete snapshot completed successfully. Apr 29 19:22:36 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d22ed7fc-a837-4f5c-9460-f3f52e51daf4 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-280b3124-2576-4bba-989b-811dc5675452-delete_snapshot" released by "delete_snapshot" :: held 3.485s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:37 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a" returned: 0 in 0.671s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.271s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1009402690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9da95fa-4d07-4610-88a2-37c65207bd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:21Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Creating volume b9da95fa-4d07-4610-88a2-37c65207bd53 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:37 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e081d67-c8ca-4acb-8a54-808d1cc670f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:37 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 1073741824 Apr 29 19:22:37 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bff57bf-e71f-4b48-a44c-0f6ae9136d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:37 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a (3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a): created successfully Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bff57bf-e71f-4b48-a44c-0f6ae9136d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (26cf68a1-d48d-4f87-94cd-043d845ba28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:37 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-56449b6f-ede7-4e89-9ae0-db1d81ed7e16 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created volume successfully. Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-59cca6dd-0b09-4206-9425-2901240c7c34-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-59cca6dd-0b09-4206-9425-2901240c7c34-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-59cca6dd-0b09-4206-9425-2901240c7c34" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-59cca6dd-0b09-4206-9425-2901240c7c34" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b046b0de-e7fc-4e7c-a9c2-bbf88460b57c]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:38 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 Apr 29 19:22:38 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:38 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 1073741824" returned: 0 in 0.939s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:38 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 Apr 29 19:22:38 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:38 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34" returned: 0 in 0.826s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:38 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:38 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34 Apr 29 19:22:38 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:39 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53" returned: 0 in 0.674s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.587s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-666500494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff8285a-b1d0-4806-8522-0ef58ed5d2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4f5add4cf1478c9d7e03bf6a52f2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:21Z,use_quota=True,user_id='a850622cc3f043df8dc73b3efa07f22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Creating volume 2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:39 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:39 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 1073741824 Apr 29 19:22:39 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a03b41-6ef1-4ab8-b9f3-fde3c6d264d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9da95fa-4d07-4610-88a2-37c65207bd53', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbbbe06-a467-4be5-9fba-76f1a7daeddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:39 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume volume-b9da95fa-4d07-4610-88a2-37c65207bd53 (b9da95fa-4d07-4610-88a2-37c65207bd53): created successfully Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbbbe06-a467-4be5-9fba-76f1a7daeddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (bd26546a-bf48-4742-971a-4c0ddd436ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:39 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-62393998-6e24-4d7f-80af-f75be606c74a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created volume successfully. Apr 29 19:22:39 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-59cca6dd-0b09-4206-9425-2901240c7c34" returned: 0 in 0.744s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-59cca6dd-0b09-4206-9425-2901240c7c34" released by "delete_volume" :: held 1.650s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Created reservations ['9e7a101b-9b5b-4582-8827-cc498b97e99f', '350a55bd-d175-4033-abae-fe852b471159', 'caa56bb6-fb56-4936-8a35-54fd3a592150', '289b80a9-dfb8-444d-93ae-bfe592c14339'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:39 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:39 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:39 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:40 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 1073741824" returned: 0 in 0.939s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:40 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 Apr 29 19:22:40 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:40 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.713s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Deleted volume successfully. Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-d53e23fe-328d-4eec-b6a0-9b8947a5017e tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-59cca6dd-0b09-4206-9425-2901240c7c34-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Flow 'volume_create_manager' (1edfe39c-85ad-4a26-8a8d-10a5ac4a177b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbe0202-7919-456d-b6bd-f797ab1190a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbe0202-7919-456d-b6bd-f797ab1190a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-886238033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2428338a-0826-4ee5-91e0-63f2d6f27673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4417a0e454b141599f9996f7d51e178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:40Z,use_quota=True,user_id='37f972bb443c4ded8ae55d2532c8c20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07fa2b4-0c5c-47b9-9166-0bcfdd19af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07fa2b4-0c5c-47b9-9166-0bcfdd19af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156feae7-2761-4716-a904-bfcc6c9575f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156feae7-2761-4716-a904-bfcc6c9575f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2428338a-0826-4ee5-91e0-63f2d6f27673', 'volume_name': 'volume-2428338a-0826-4ee5-91e0-63f2d6f27673', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdc6c95-1237-4be0-a3ed-1da1715242ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdc6c95-1237-4be0-a3ed-1da1715242ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2b099a-905d-4fc5-9f99-422c5e3eb843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:40 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Volume 2428338a-0826-4ee5-91e0-63f2d6f27673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2428338a-0826-4ee5-91e0-63f2d6f27673', 'volume_size': 1} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:40 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4" returned: 0 in 0.792s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.810s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1472140051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2163d8-ca69-449c-85df-22355976e5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:24Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Creating volume 7d2163d8-ca69-449c-85df-22355976e5f2 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:40 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72a92d8-f9de-4034-b00b-f095a7fe55ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:40 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 1073741824 Apr 29 19:22:40 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e07f044-fdf8-4008-82fd-f7e929d258d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:40 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Volume volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 (2ff8285a-b1d0-4806-8522-0ef58ed5d2d4): created successfully Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e07f044-fdf8-4008-82fd-f7e929d258d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:40 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Flow 'volume_create_manager' (06668e85-a9ee-4bf8-811f-18ea6389df98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:40 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-21cfd616-7bd6-4884-8128-ed9f45cbf4c6 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created volume successfully. Apr 29 19:22:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-quobyte-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:41 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4" acquired by "delete_volume" :: waited 0.027s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:41 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaa8cca-1d96-4485-9d06-fe8d48e2aa5f]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:41 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 1073741824" returned: 0 in 0.968s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:41 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:41 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 Apr 29 19:22:41 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:41 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 Apr 29 19:22:41 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:42 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2" returned: 0 in 0.631s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:42 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-886238033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2428338a-0826-4ee5-91e0-63f2d6f27673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4417a0e454b141599f9996f7d51e178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:40Z,use_quota=True,user_id='37f972bb443c4ded8ae55d2532c8c20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Creating volume 2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:42 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4" returned: 0 in 0.769s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:42 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 1073741824 Apr 29 19:22:42 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:42 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4 Apr 29 19:22:42 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ddbd7f-4757-4db4-b740-cce63d715f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2163d8-ca69-449c-85df-22355976e5f2', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c17c228-b1eb-4088-9e17-afd68541133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:42 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume volume-7d2163d8-ca69-449c-85df-22355976e5f2 (7d2163d8-ca69-449c-85df-22355976e5f2): created successfully Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c17c228-b1eb-4088-9e17-afd68541133c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:42 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (acdf99af-c02f-4840-82d9-a24e2e4c7cb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:42 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-53ca27dc-1f70-4a98-b051-d761bf877b8c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created volume successfully. Apr 29 19:22:43 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4" returned: 0 in 0.795s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4" released by "delete_volume" :: held 1.626s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created reservations ['dcff3092-ad13-4eec-964b-6d397bc3f7fc', 'dc7be4f9-8d2b-4e35-a742-afdb079d8843', '03088b6d-10d6-401c-9650-2c8568f74b12', 'c5a75732-aa32-4599-9ec1-e231d816cd09'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:43 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:43 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:43 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 1073741824" returned: 0 in 1.079s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:43 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:43 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 Apr 29 19:22:43 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-b9da95fa-4d07-4610-88a2-37c65207bd53-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-b9da95fa-4d07-4610-88a2-37c65207bd53-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-quobyte-b9da95fa-4d07-4610-88a2-37c65207bd53" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-b9da95fa-4d07-4610-88a2-37c65207bd53" acquired by "delete_volume" :: waited 0.020s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[937bb167-ea3f-4607-ae8f-9ce39a4ae190]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:44 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 Apr 29 19:22:44 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:44 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.036s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:44 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Deleted volume successfully. Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-c7bf9cdb-5a2f-4716-8663-fb06b0463281 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-2ff8285a-b1d0-4806-8522-0ef58ed5d2d4-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (6f56d4e3-6b64-4969-93a6-578fbbbefd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fb55a8-3114-4dd2-8672-99c2c73fbb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fb55a8-3114-4dd2-8672-99c2c73fbb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1962502427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:45Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a595690d-70ce-4ab2-ab7b-2221b079ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a595690d-70ce-4ab2-ab7b-2221b079ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee275747-ca46-4eef-8664-0a131495396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee275747-ca46-4eef-8664-0a131495396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922', 'volume_name': 'volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:44 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ff8de7-b0aa-4ede-a231-575e903fe9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ff8de7-b0aa-4ede-a231-575e903fe9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48714dbc-8efa-4941-9c54-c82ea26901ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:44 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume 7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922', 'volume_size': 1} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673" returned: 0 in 1.325s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] <== create_volume: return (2478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:44 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.481s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1962502427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:45Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Creating volume 7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:45 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2b099a-905d-4fc5-9f99-422c5e3eb843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2428338a-0826-4ee5-91e0-63f2d6f27673', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 1073741824 Apr 29 19:22:45 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637606ae-2aab-4d6e-8b74-f64fb4c40e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Volume volume-2428338a-0826-4ee5-91e0-63f2d6f27673 (2428338a-0826-4ee5-91e0-63f2d6f27673): created successfully Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637606ae-2aab-4d6e-8b74-f64fb4c40e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Flow 'volume_create_manager' (1edfe39c-85ad-4a26-8a8d-10a5ac4a177b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:45 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (5e33fcc5-c235-4a9d-be02-d71b0304d54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6351a0-5e45-4d4b-a7a5-179ba2c61f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c3474a6f-1dee-4ec7-b253-a2957491d9aa tempest-VolumeDependencyTests-1145165108 None] Created volume successfully. Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53" returned: 0 in 1.147s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:45 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53 Apr 29 19:22:45 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6351a0-5e45-4d4b-a7a5-179ba2c61f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1166720583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29ce5df-96cb-4047-af08-3edeed71e673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:45Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6acb7da-5fe6-4ffd-91c3-5d47cb0e767e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6acb7da-5fe6-4ffd-91c3-5d47cb0e767e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3664a1-9600-4c57-8ac1-d1baf8343e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3664a1-9600-4c57-8ac1-d1baf8343e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29ce5df-96cb-4047-af08-3edeed71e673', 'volume_name': 'volume-e29ce5df-96cb-4047-af08-3edeed71e673', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8b2fe2-86e1-44ca-8e66-eed54940dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8b2fe2-86e1-44ca-8e66-eed54940dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd77fb6-3100-4dc0-8c81-2d2baced1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume e29ce5df-96cb-4047-af08-3edeed71e673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29ce5df-96cb-4047-af08-3edeed71e673', 'volume_size': 1} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (bae1dc97-5707-4126-8714-07a1e70ace16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abe3e30-2e6f-4c4d-94a3-0dde97b46c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abe3e30-2e6f-4c4d-94a3-0dde97b46c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165436306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e695a88d-738d-486a-b1e2-67649fec1975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:45Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f5f284-9647-4438-a0ab-c4a9ee6bd2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f5f284-9647-4438-a0ab-c4a9ee6bd2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c875e412-832b-470c-8de2-792d19bfdd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c875e412-832b-470c-8de2-792d19bfdd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e695a88d-738d-486a-b1e2-67649fec1975', 'volume_name': 'volume-e695a88d-738d-486a-b1e2-67649fec1975', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e11514-b4a5-4541-983a-20d211b1e439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e11514-b4a5-4541-983a-20d211b1e439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e745685-7bba-40d5-a0af-7420627a28cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:45 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume e695a88d-738d-486a-b1e2-67649fec1975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e695a88d-738d-486a-b1e2-67649fec1975', 'volume_size': 1} Apr 29 19:22:45 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (bdf5ca48-e699-478d-bacf-d441713a204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6ec778-ba45-4ef5-9489-bf321bb5b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6ec778-ba45-4ef5-9489-bf321bb5b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611583697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888914b6-b4b2-423f-bec5-62e5e7fd25ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:46Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d48d86-0627-46df-80fc-db5b92679b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d48d86-0627-46df-80fc-db5b92679b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee5deef-5a3f-4bfa-b990-bf10b301dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee5deef-5a3f-4bfa-b990-bf10b301dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '888914b6-b4b2-423f-bec5-62e5e7fd25ac', 'volume_name': 'volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcced72-54e2-43f7-8604-0f47cf18927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcced72-54e2-43f7-8604-0f47cf18927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:46 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967dbd76-b2ae-47c3-b03c-799f35a5e45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:46 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume 888914b6-b4b2-423f-bec5-62e5e7fd25ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac', 'volume_size': 1} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-b9da95fa-4d07-4610-88a2-37c65207bd53" returned: 0 in 1.111s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-b9da95fa-4d07-4610-88a2-37c65207bd53" released by "delete_volume" :: held 2.342s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:46 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 1073741824" returned: 0 in 1.515s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created reservations ['822b015b-2490-4d7d-aa33-96f5e3ad8b1a', 'de068b58-a8b1-43a4-b395-ff1c96a3ac1d', 'f5475b95-1898-447e-b40a-1352cba2ced3', '4e121620-25b4-4e02-a4bb-fa35bcd7c680'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:46 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 Apr 29 19:22:46 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:46 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:46 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (bffb882d-7b94-4aba-aa31-51175d532b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fbb3e4-db87-40d4-862f-cb6f63404f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fbb3e4-db87-40d4-862f-cb6f63404f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-946502035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142541cf-9a40-41f7-8c1a-6ec69e41f58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:47Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bdcc9e-b2c1-4f66-b263-7eef8813e8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bdcc9e-b2c1-4f66-b263-7eef8813e8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fc12f1-fb6a-4a60-a70f-303440a62e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fc12f1-fb6a-4a60-a70f-303440a62e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142541cf-9a40-41f7-8c1a-6ec69e41f58f', 'volume_name': 'volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:46 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463b8def-0126-49be-bbbd-8c4acb4a0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463b8def-0126-49be-bbbd-8c4acb4a0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0fcebc-a8fe-435b-8756-e6a6cb2d4823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:47 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume 142541cf-9a40-41f7-8c1a-6ec69e41f58f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f', 'volume_size': 1} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Flow 'volume_create_manager' (018e125e-a232-48e4-af33-3c6df66995c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5727ea-b596-48ae-b020-3ed3331c9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5727ea-b596-48ae-b020-3ed3331c9350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1289701308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576d10f2-12ae-409c-856c-b5152a439af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4417a0e454b141599f9996f7d51e178e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2428338a-0826-4ee5-91e0-63f2d6f27673,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:47Z,use_quota=True,user_id='37f972bb443c4ded8ae55d2532c8c20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2d336a-66ba-4877-bcad-072eeb5c48a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2d336a-66ba-4877-bcad-072eeb5c48a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3474250c-4fa2-4be9-b71e-064690b43fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3474250c-4fa2-4be9-b71e-064690b43fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '576d10f2-12ae-409c-856c-b5152a439af5', 'volume_name': 'volume-576d10f2-12ae-409c-856c-b5152a439af5', 'volume_size': 1, 'source_volid': '2428338a-0826-4ee5-91e0-63f2d6f27673', 'source_volstatus': 'available'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc2c973-f9d7-4070-86a0-283409dcb166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc2c973-f9d7-4070-86a0-283409dcb166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f572c08-81f0-4efa-be12-dd7e80235d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:47 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Volume 576d10f2-12ae-409c-856c-b5152a439af5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-576d10f2-12ae-409c-856c-b5152a439af5', 'volume_size': 1, 'source_volid': '2428338a-0826-4ee5-91e0-63f2d6f27673', 'source_volstatus': 'available'} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:47 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922" returned: 0 in 0.787s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] <== create_volume: return (2396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.407s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.887s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1166720583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29ce5df-96cb-4047-af08-3edeed71e673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:45Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Creating volume e29ce5df-96cb-4047-af08-3edeed71e673 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:47 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48714dbc-8efa-4941-9c54-c82ea26901ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:47 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 1073741824 Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c76881-6672-421c-81e4-ea1d15249696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:47 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:47 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 (7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922): created successfully Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c76881-6672-421c-81e4-ea1d15249696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (6f56d4e3-6b64-4969-93a6-578fbbbefd10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:47 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-6236c9ec-e892-48c2-81f2-1a896027a707 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created volume successfully. Apr 29 19:22:47 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.860s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:47 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Deleted volume successfully. Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-5e20ba28-3af5-47bd-8d35-c21ab8c7ae59 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-b9da95fa-4d07-4610-88a2-37c65207bd53-delete_volume" released by "delete_volume" :: held 3.645s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:47 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-quobyte-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a" acquired by "delete_volume" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e7588-4ee8-4e0c-b8dd-a3bd70d4d5fd]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:48 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a Apr 29 19:22:48 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:48 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 1073741824" returned: 0 in 1.219s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=162,cinder:SELECT=116,cinder:INSERT=36,cinder:DELETE=15 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:48 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 Apr 29 19:22:48 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:48 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a" returned: 0 in 0.902s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:48 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:49 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a Apr 29 19:22:49 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:49 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673" returned: 0 in 0.683s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.616s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165436306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e695a88d-738d-486a-b1e2-67649fec1975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:45Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Creating volume e695a88d-738d-486a-b1e2-67649fec1975 {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:49 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:SELECT=116,cinder:UPDATE=144,cinder:DELETE=16,cinder:INSERT=33 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd77fb6-3100-4dc0-8c81-2d2baced1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29ce5df-96cb-4047-af08-3edeed71e673', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:49 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 1073741824 Apr 29 19:22:49 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f49f433-4b33-4ea8-837d-741212e57c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:49 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume volume-e29ce5df-96cb-4047-af08-3edeed71e673 (e29ce5df-96cb-4047-af08-3edeed71e673): created successfully Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f49f433-4b33-4ea8-837d-741212e57c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (5e33fcc5-c235-4a9d-be02-d71b0304d54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:49 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-b5d1caa4-a0ce-4b33-8228-f7fc9d32aa7c tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created volume successfully. Apr 29 19:22:49 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a" returned: 0 in 0.723s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a" released by "delete_volume" :: held 1.689s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created reservations ['4de5e807-7eb2-44fe-8b37-827bef4561ad', 'b52ead47-56f4-4d69-b272-d4b117a0303e', 'd2270632-7e76-43a5-a9fc-44e0dda8c3dd', '8433f104-1f86-491d-9056-fc01a0f8b5c3'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:49 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:49 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:49 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-57f54677-6092-4960-9c5f-c13faf62f8e8-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-57f54677-6092-4960-9c5f-c13faf62f8e8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-quobyte-57f54677-6092-4960-9c5f-c13faf62f8e8" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-57f54677-6092-4960-9c5f-c13faf62f8e8" acquired by "delete_volume" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:50 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 1073741824" returned: 0 in 1.045s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4349ceda-0b3c-4812-82ed-beb692251e6e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:50 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 Apr 29 19:22:50 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:50 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 Apr 29 19:22:50 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:50 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.896s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:50 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Deleted volume successfully. Apr 29 19:22:50 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-468c4380-daca-4363-b6ea-65ab5dc0d525 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-3dd5cbe0-9626-4daa-9ae4-10bdb0693b1a-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:51 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975" returned: 0 in 0.766s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.852s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611583697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888914b6-b4b2-423f-bec5-62e5e7fd25ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:46Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Creating volume 888914b6-b4b2-423f-bec5-62e5e7fd25ac {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:51 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:51 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8" returned: 0 in 0.872s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:51 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac 1073741824 Apr 29 19:22:51 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:51 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8 Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e745685-7bba-40d5-a0af-7420627a28cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e695a88d-738d-486a-b1e2-67649fec1975', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:51 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d2e510-30c5-4ce5-8594-f30a7d1f8ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:51 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume volume-e695a88d-738d-486a-b1e2-67649fec1975 (e695a88d-738d-486a-b1e2-67649fec1975): created successfully Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d2e510-30c5-4ce5-8594-f30a7d1f8ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:51 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (bae1dc97-5707-4126-8714-07a1e70ace16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:51 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-84c399b4-91cc-4de1-b8e5-b73ccae63dd5 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created volume successfully. Apr 29 19:22:52 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-57f54677-6092-4960-9c5f-c13faf62f8e8" returned: 0 in 0.761s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-57f54677-6092-4960-9c5f-c13faf62f8e8" released by "delete_volume" :: held 1.727s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created reservations ['45353695-e2e9-4778-bfbf-b19b5a833f2e', '8e3cb722-67e6-49a3-9b7c-6715fd1cd9ad', 'e74a0097-6df5-4688-9fdf-2380839e96d2', '4fbfe224-20e4-4736-a21c-5a6f3290a167'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:52 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac 1073741824" returned: 0 in 0.900s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:52 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac Apr 29 19:22:52 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:52 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:52 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-f1ae2b86-415f-43f9-a6f1-c4e793a03706-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-f1ae2b86-415f-43f9-a6f1-c4e793a03706-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-quobyte-f1ae2b86-415f-43f9-a6f1-c4e793a03706" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-f1ae2b86-415f-43f9-a6f1-c4e793a03706" acquired by "delete_volume" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9742fab-48a2-4f18-a1f2-90d0ce91790b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:52 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.705s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:52 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:52 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 Apr 29 19:22:52 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:52 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Deleted volume successfully. Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8f243649-9727-4cf7-80ab-9e14e5e1203a tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-57f54677-6092-4960-9c5f-c13faf62f8e8-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:53 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac" returned: 0 in 0.776s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.011s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-946502035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142541cf-9a40-41f7-8c1a-6ec69e41f58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce81301feeaf4e8d91e632fd8689965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:22:47Z,use_quota=True,user_id='1a7142277e1b4c2398ddcd50fe54cb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Creating volume 142541cf-9a40-41f7-8c1a-6ec69e41f58f {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:22:53 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967dbd76-b2ae-47c3-b03c-799f35a5e45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172e1b2c-a16b-4e95-b805-d818fa6797c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:53 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f 1073741824 Apr 29 19:22:53 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:53 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac (888914b6-b4b2-423f-bec5-62e5e7fd25ac): created successfully Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172e1b2c-a16b-4e95-b805-d818fa6797c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (bdf5ca48-e699-478d-bacf-d441713a204e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:53 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-fe59aa30-80dd-4e68-b449-3964d2727aaa tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created volume successfully. Apr 29 19:22:53 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706" returned: 0 in 0.893s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:53 devstack sudo[93373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706 Apr 29 19:22:53 devstack sudo[93373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:53 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f 1073741824" returned: 0 in 0.854s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:53 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:53 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f Apr 29 19:22:53 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:54 devstack sudo[93373]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-f1ae2b86-415f-43f9-a6f1-c4e793a03706" returned: 0 in 0.689s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-f1ae2b86-415f-43f9-a6f1-c4e793a03706" released by "delete_volume" :: held 1.652s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created reservations ['db8cd0e3-3d84-43b9-9c1a-83fdcc61c9bf', 'dc2f0eda-9324-4031-8d5c-942a25712306', '3cd84a1f-33d6-4976-84f9-3463a365ab2f', '8aec74a4-3882-449c-98ff-1ed9a6832de7'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:54 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:54 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:54 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f" returned: 0 in 0.909s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.498s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:54 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Cloning volume 2428338a-0826-4ee5-91e0-63f2d6f27673 to volume 576d10f2-12ae-409c-856c-b5152a439af5 Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0fcebc-a8fe-435b-8756-e6a6cb2d4823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e5db0d-5ebb-433f-bd88-a7edab5e7c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Creating offline snapshot d10b7923-40b5-4f66-8191-229ca26ecf89 of volume 2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-0e404f7b-4f71-41d2-be91-1fa2d917efb6-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[25af8270-5228-44be-92b8-2ae543fb1dc3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:54 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Volume volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f (142541cf-9a40-41f7-8c1a-6ec69e41f58f): created successfully Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e5db0d-5ebb-433f-bd88-a7edab5e7c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Flow 'volume_create_manager' (bffb882d-7b94-4aba-aa31-51175d532b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:22:54 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:55 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-c025ade3-0670-4314-8d67-6270749ca780 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created volume successfully. Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-0e404f7b-4f71-41d2-be91-1fa2d917efb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-quobyte-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-quobyte-0e404f7b-4f71-41d2-be91-1fa2d917efb6" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-0e404f7b-4f71-41d2-be91-1fa2d917efb6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Deleting offline snapshot 0e404f7b-4f71-41d2-be91-1fa2d917efb6 of volume 9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] snapshot_file for this snap is: volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:22:55 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4ad38c-b610-406c-84ca-c9ab50688395]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:55 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:55 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 Apr 29 19:22:55 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:55 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.794s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:55 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Deleted volume successfully. Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-467d6a9f-830c-4832-b592-f4dcd6dd4f6b tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-f1ae2b86-415f-43f9-a6f1-c4e793a03706-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:55 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673" returned: 0 in 0.781s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:55 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 1G Apr 29 19:22:55 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-142541cf-9a40-41f7-8c1a-6ec69e41f58f-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:55 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-142541cf-9a40-41f7-8c1a-6ec69e41f58f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:55 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6" returned: 0 in 0.900s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-quobyte-142541cf-9a40-41f7-8c1a-6ec69e41f58f" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec0c6dc-1e9e-45fd-913d-07d23e34631d]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-142541cf-9a40-41f7-8c1a-6ec69e41f58f" acquired by "delete_volume" :: waited 0.034s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbc0377-585c-4c31-9901-a112bfdb39c4]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:56 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 Apr 29 19:22:56 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:56 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f Apr 29 19:22:56 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:56 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 1G" returned: 0 in 0.946s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2428338a-0826-4ee5-91e0-63f2d6f27673 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:56 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2428338a-0826-4ee5-91e0-63f2d6f27673 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 Apr 29 19:22:56 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:56 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f" returned: 0 in 0.886s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:56 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:56 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" returned: 0 in 0.959s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:57 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f Apr 29 19:22:57 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:57 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 Apr 29 19:22:57 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:57 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2428338a-0826-4ee5-91e0-63f2d6f27673 -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89" returned: 0 in 0.904s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:57 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 is being set with open permissions: ugo+rw Apr 29 19:22:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:57 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 Apr 29 19:22:57 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:57 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:57 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-142541cf-9a40-41f7-8c1a-6ec69e41f58f" returned: 0 in 0.920s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:57 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-142541cf-9a40-41f7-8c1a-6ec69e41f58f" released by "delete_volume" :: held 1.869s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:57 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6" returned: 0 in 0.999s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created reservations ['c4f9a79a-f881-48ef-89e3-63c0fffd2bc4', '362e1afd-968e-4a13-8f11-e0584f00fb2b', 'a82c79a1-9be5-439a-b625-1dadf971f80f', '1f6b95b6-27bb-4bb5-b2fb-6d0734cda896'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:58 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6 Apr 29 19:22:58 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:58 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:22:58 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-888914b6-b4b2-423f-bec5-62e5e7fd25ac-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-888914b6-b4b2-423f-bec5-62e5e7fd25ac-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-quobyte-888914b6-b4b2-423f-bec5-62e5e7fd25ac" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-888914b6-b4b2-423f-bec5-62e5e7fd25ac" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2ac199-935c-45d6-8030-141dae37ca72]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:58 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89" returned: 0 in 0.826s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:58 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.info Apr 29 19:22:58 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:58 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac Apr 29 19:22:58 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:58 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0.0e404f7b-4f71-41d2-be91-1fa2d917efb6" returned: 0 in 0.919s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:58 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-0e404f7b-4f71-41d2-be91-1fa2d917efb6" released by "_delete_snapshot" :: held 3.913s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" released by "delete_snapshot" :: held 3.949s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:59 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.874s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:22:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Deleted volume successfully. Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-df9fbf44-dbd0-451f-beb5-ae80d8df3409 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-142541cf-9a40-41f7-8c1a-6ec69e41f58f-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created reservations ['80d89310-1e9a-436e-acce-22374e62f34b', '1501b4ed-b741-44c9-b132-4197dbe0d6b8', '5de0ecb9-56b4-4f70-83ac-74395c579f79', '25906c32-814a-42c3-854c-77f9b98b5dab'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:22:59 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Delete snapshot completed successfully. Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-1aff6375-23b6-44fb-86b2-0b4e012a4346 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-0e404f7b-4f71-41d2-be91-1fa2d917efb6-delete_snapshot" released by "delete_snapshot" :: held 4.149s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "cinder-quobyte-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" acquired by "delete_volume" :: waited 0.039s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:22:59 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.info" returned: 0 in 0.997s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:59 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.info is being set with open permissions: ugo+rw Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0de46-0936-4199-bdbc-e4f60d4e6ef9]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:59 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.info Apr 29 19:22:59 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:59 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac" returned: 0 in 1.130s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:22:59 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:22:59 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac Apr 29 19:22:59 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:22:59 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 Apr 29 19:22:59 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:00 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:00 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.info" returned: 0 in 0.801s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-576d10f2-12ae-409c-856c-b5152a439af5" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-888914b6-b4b2-423f-bec5-62e5e7fd25ac" returned: 0 in 0.757s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-888914b6-b4b2-423f-bec5-62e5e7fd25ac" released by "delete_volume" :: held 1.947s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-576d10f2-12ae-409c-856c-b5152a439af5" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] snapshot: d10b7923-40b5-4f66-8191-229ca26ecf89, volume: 576d10f2-12ae-409c-856c-b5152a439af5, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f3a0bb-c2d5-4ed5-89c5-cd575913af11]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:00 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" returned: 0 in 0.894s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:00 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0 Apr 29 19:23:00 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created reservations ['183854d8-23b1-45fc-a66c-14449aecba9e', 'd1160374-6c3b-43c7-a2d8-6aee80d60202', 'd41cddf7-5f9f-4fd2-b729-a72def4fba3a', '505d9563-2f08-4087-a2d5-c819f8452aca'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:00 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 Apr 29 19:23:00 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:00 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:00 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:00 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:01 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" returned: 0 in 1.050s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-quobyte-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0" released by "delete_volume" :: held 2.051s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:01 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89" returned: 0 in 1.131s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2428338a-0826-4ee5-91e0-63f2d6f27673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f0dd6-9100-4f63-86c0-4426e2bc019e]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:01 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.957s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:01 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Deleted volume successfully. Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Created reservations ['4ea9e8e2-e86a-46d9-8fb7-a77229e4b9ca', '201eef18-7483-4486-b59d-d89fb98361c7', '4bdb74e5-20d6-49b3-a36e-17d35485f522', '1eabc76b-d8aa-4717-94c3-7942197ed8be'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-ac3e2ba7-b438-4891-b5a8-cebc873274c3 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-888914b6-b4b2-423f-bec5-62e5e7fd25ac-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:01 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 Apr 29 19:23:01 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:01 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-e695a88d-738d-486a-b1e2-67649fec1975-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:01 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-e695a88d-738d-486a-b1e2-67649fec1975-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-quobyte-e695a88d-738d-486a-b1e2-67649fec1975" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-e695a88d-738d-486a-b1e2-67649fec1975" acquired by "delete_volume" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb2bed-bd14-4870-b408-686bfa080105]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:01 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:02 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 Apr 29 19:23:02 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:02 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.720s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:02 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Deleted volume successfully. Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-9e24ee9a-d7f6-4cbe-beef-82b0d4270b19 tempest-CreateVolumesFromSnapshotTest-1416597810 None] Lock "cinder-9e455df0-fc23-4c7c-b53c-bc85d62a9bd0-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:02 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673" returned: 0 in 0.979s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:02 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 Apr 29 19:23:02 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Flow 'volume_create_manager' (04a81b03-9966-445f-b477-61baa5c51d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2599c13b-67b1-4443-9639-f453bd0127d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2599c13b-67b1-4443-9639-f453bd0127d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1020536498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdde1b5-d705-48c3-90e4-5183f10de8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425efb91800249829a6de3a6ffe3682d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:23:03Z,use_quota=True,user_id='38861312f1a349348eb8a5daaa36a24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62f068b-6501-489a-b6fd-c6608970b30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62f068b-6501-489a-b6fd-c6608970b30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aaf10e-a91b-4e0f-93d0-4e64472dd3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aaf10e-a91b-4e0f-93d0-4e64472dd3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cdde1b5-d705-48c3-90e4-5183f10de8af', 'volume_name': 'volume-5cdde1b5-d705-48c3-90e4-5183f10de8af', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063dbecb-e4d1-4a6d-9f7c-069ef95bd100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063dbecb-e4d1-4a6d-9f7c-069ef95bd100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c06f96-9e44-4938-8136-8fc77f1822c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:02 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Volume 5cdde1b5-d705-48c3-90e4-5183f10de8af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cdde1b5-d705-48c3-90e4-5183f10de8af', 'volume_size': 1} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:02 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975" returned: 0 in 0.972s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:02 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:02 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975 Apr 29 19:23:02 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:03 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e695a88d-738d-486a-b1e2-67649fec1975" returned: 0 in 0.719s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-e695a88d-738d-486a-b1e2-67649fec1975" released by "delete_volume" :: held 1.765s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created reservations ['be9a19db-0c6f-4b1f-9e00-71bdf1146906', '9e28a9ed-678d-495b-b3d5-36571efaaeb6', 'ea1bcd2e-377f-4b2f-9ae0-98299c65fa25', '16589eb4-3150-4b24-b307-af0254c68669'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:03 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:04 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:04 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-e29ce5df-96cb-4047-af08-3edeed71e673-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-e29ce5df-96cb-4047-af08-3edeed71e673-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-quobyte-e29ce5df-96cb-4047-af08-3edeed71e673" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:04 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-e29ce5df-96cb-4047-af08-3edeed71e673" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:04 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15df2a4-a771-48c1-b791-6569eb93fa3b]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:04 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:04 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 Apr 29 19:23:04 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:05 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.764s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:05 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:05 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Deleted volume successfully. Apr 29 19:23:05 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-19283959-f48d-4ea6-9f26-5b15f7c8d15e tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-e695a88d-738d-486a-b1e2-67649fec1975-delete_volume" released by "delete_volume" :: held 4.068s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:05 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673" returned: 0 in 1.456s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:05 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:05 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673 Apr 29 19:23:05 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:07 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-e29ce5df-96cb-4047-af08-3edeed71e673" returned: 0 in 1.318s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-e29ce5df-96cb-4047-af08-3edeed71e673" released by "delete_volume" :: held 2.885s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created reservations ['ed5d3ccc-b9ae-4ea7-8ef3-9de176bc1f55', '21e694a2-ba74-45d5-bc6f-3c998648e2c8', 'd29e446d-40cc-49f4-a7d8-bafcb2634a6d', '0115dfdf-af0d-4194-a16f-9db25b1de302'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:07 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:07 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:07 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-quobyte-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922" acquired by "delete_volume" :: waited 0.060s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98eb4cd-e093-4887-8f75-76324ea33bc5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:08 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 Apr 29 19:23:08 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:08 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 1.065s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:08 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Deleted volume successfully. Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-0d6dad0a-97c0-48e7-aafb-a3a23a35c23a tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-e29ce5df-96cb-4047-af08-3edeed71e673-delete_volume" released by "delete_volume" :: held 4.512s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5" returned: 0 in 6.250s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4afd3a5-faf3-4eb4-889c-02623b81a4c3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:08 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:08 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 Apr 29 19:23:08 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:09 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922" returned: 0 in 0.895s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:09 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922 Apr 29 19:23:09 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:09 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673" returned: 0 in 0.866s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:23:09 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Converted 1024.00 MB image at 163.83 MB/s Apr 29 19:23:09 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 is being set with open permissions: ugo+rw Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:09 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 Apr 29 19:23:09 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:09 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922" returned: 0 in 0.629s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922" released by "delete_volume" :: held 1.618s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created reservations ['82c1a2ea-5f55-4e27-82b9-311fa3fcea2f', '3e46bbd2-324b-4b6e-87e6-7a01ef87d904', '607b83a0-3825-41c1-8b8c-1bdb153bd962', '9e443c76-e428-461c-a6f6-cb0af7eaaaed'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:09 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:09 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:09 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:10 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5" returned: 0 in 0.631s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-576d10f2-12ae-409c-856c-b5152a439af5" released by "_copy_volume_from_snapshot" :: held 9.967s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-d10b7923-40b5-4f66-8191-229ca26ecf89" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-d10b7923-40b5-4f66-8191-229ca26ecf89" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Deleting offline snapshot d10b7923-40b5-4f66-8191-229ca26ecf89 of volume 2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] snapshot_file for this snap is: volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-7d2163d8-ca69-449c-85df-22355976e5f2-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[507cf2ef-cbba-4809-9b09-f246623d7643]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-7d2163d8-ca69-449c-85df-22355976e5f2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "cinder-quobyte-7d2163d8-ca69-449c-85df-22355976e5f2" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-7d2163d8-ca69-449c-85df-22355976e5f2" acquired by "delete_volume" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf218c-c093-48a6-90e9-dbeba1d88610]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:10 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 Apr 29 19:23:10 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:10 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.641s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:10 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Deleted volume successfully. Apr 29 19:23:10 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-4686dc42-7785-4a70-b79a-00c5052841d8 tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-7dd5a9e7-9a1b-48f0-b6ed-1751c21f2922-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:10 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 Apr 29 19:23:10 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:11 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89" returned: 0 in 0.768s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2428338a-0826-4ee5-91e0-63f2d6f27673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c5b89d-2237-47fd-902b-c0ec29a9a313]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:11 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2" returned: 0 in 0.724s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:11 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2 Apr 29 19:23:11 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:11 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 Apr 29 19:23:11 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:11 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-7d2163d8-ca69-449c-85df-22355976e5f2" returned: 0 in 0.612s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-quobyte-7d2163d8-ca69-449c-85df-22355976e5f2" released by "delete_volume" :: held 1.377s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:11 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673" returned: 0 in 0.717s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Created reservations ['235bf8e3-c636-4783-a4bf-91f9fb83bd8e', '4881cf28-1b01-4f01-b463-a24748c80f35', '7b76721e-81ce-42c9-bbbe-35a3a25123c1', '35e7c598-fab2-4792-8f06-31b43dc14618'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:11 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 Apr 29 19:23:11 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:11 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:12 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:12 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:12 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.652s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:12 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:12 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Deleted volume successfully. Apr 29 19:23:12 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89" returned: 0 in 0.754s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:12 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:12 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-98dd6a2e-62d5-4834-b61e-39a1f7a8680f tempest-CreateVolumesFromSourceVolumeTest-1748623436 None] Lock "cinder-7d2163d8-ca69-449c-85df-22355976e5f2-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:12 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89 Apr 29 19:23:12 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:13 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673.d10b7923-40b5-4f66-8191-229ca26ecf89" returned: 0 in 0.665s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-d10b7923-40b5-4f66-8191-229ca26ecf89" released by "_delete_snapshot" :: held 3.016s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.538s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.658s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1020536498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdde1b5-d705-48c3-90e4-5183f10de8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425efb91800249829a6de3a6ffe3682d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:23:03Z,use_quota=True,user_id='38861312f1a349348eb8a5daaa36a24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)}" {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Creating volume 5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:23:13 devstack cinder-volume[84523]: INFO cinder.volume.drivers.remotefs [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] casted to osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af 1073741824 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f572c08-81f0-4efa-be12-dd7e80235d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576d10f2-12ae-409c-856c-b5152a439af5', 'volume_size': 1, 'source_volid': '2428338a-0826-4ee5-91e0-63f2d6f27673', 'source_volstatus': 'available'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2bfc11-3286-491e-9a58-a72f4144e41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:13 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af 1073741824 Apr 29 19:23:13 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:13 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Volume volume-576d10f2-12ae-409c-856c-b5152a439af5 (576d10f2-12ae-409c-856c-b5152a439af5): created successfully Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2bfc11-3286-491e-9a58-a72f4144e41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:13 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Flow 'volume_create_manager' (018e125e-a232-48e4-af33-3c6df66995c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:23:13 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-7b647102-34a8-41e3-814d-32f58cc00817 tempest-VolumeDependencyTests-1145165108 None] Created volume successfully. Apr 29 19:23:14 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af 1073741824" returned: 0 in 0.845s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:14 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af Apr 29 19:23:14 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-2428338a-0826-4ee5-91e0-63f2d6f27673-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-2428338a-0826-4ee5-91e0-63f2d6f27673-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-2428338a-0826-4ee5-91e0-63f2d6f27673" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-2428338a-0826-4ee5-91e0-63f2d6f27673" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4130442a-8888-4b5a-a38e-cc2bddc764b3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:14 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 Apr 29 19:23:14 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:14 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af" returned: 0 in 0.623s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'} {{(pid=84523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c06f96-9e44-4938-8136-8fc77f1822c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cdde1b5-d705-48c3-90e4-5183f10de8af', 'volume_size': 1}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46536a38-b491-4454-b78c-ca9013a16220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:14 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Volume volume-5cdde1b5-d705-48c3-90e4-5183f10de8af (5cdde1b5-d705-48c3-90e4-5183f10de8af): created successfully Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46536a38-b491-4454-b78c-ca9013a16220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:14 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Flow 'volume_create_manager' (04a81b03-9966-445f-b477-61baa5c51d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:23:14 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-acf8cd3d-1a87-4101-826e-72b5d56b9efa tempest-SnapshotDependencyTests-2032207443 None] Created volume successfully. Apr 29 19:23:15 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673" returned: 0 in 0.730s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:15 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673 Apr 29 19:23:15 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:15 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-2428338a-0826-4ee5-91e0-63f2d6f27673" returned: 0 in 0.632s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-2428338a-0826-4ee5-91e0-63f2d6f27673" released by "delete_volume" :: held 1.426s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Created reservations ['9dadfe68-2ee5-4cfb-a81f-0ef0fe8f6593', '695f89b7-cba6-4281-aa59-512216abeb86', 'd1cee45e-4ba9-49e5-b92b-46aed1cac1ae', 'dd801088-9063-4049-b861-d8e77949c973'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:15 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:16 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:16 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Creating offline snapshot 2acb4ff0-35d1-4322-bf1e-6ebf03f8458e of volume 5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c34185f-ae25-4801-9858-b2703ad8ba53]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:16 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af Apr 29 19:23:16 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-576d10f2-12ae-409c-856c-b5152a439af5-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-576d10f2-12ae-409c-856c-b5152a439af5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:16 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.673s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:16 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Deleted volume successfully. Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-576d10f2-12ae-409c-856c-b5152a439af5" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-576d10f2-12ae-409c-856c-b5152a439af5" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-8409da99-5843-496e-bb6e-c7625690556b tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-2428338a-0826-4ee5-91e0-63f2d6f27673-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[749642c2-bac5-4bdf-9399-8ebf44034261]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:16 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af" returned: 0 in 0.732s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:16 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e 1G {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:16 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e 1G Apr 29 19:23:16 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:16 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 Apr 29 19:23:16 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:17 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5" returned: 0 in 0.727s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:17 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5 Apr 29 19:23:17 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:17 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e 1G" returned: 0 in 0.752s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:17 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cdde1b5-d705-48c3-90e4-5183f10de8af -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:17 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cdde1b5-d705-48c3-90e4-5183f10de8af -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e Apr 29 19:23:17 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:18 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-576d10f2-12ae-409c-856c-b5152a439af5" returned: 0 in 0.650s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-576d10f2-12ae-409c-856c-b5152a439af5" released by "delete_volume" :: held 1.425s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Created reservations ['d1ed4128-e2e9-4ebf-ac99-a9bd3a9f7c5a', '67eda394-cd3a-405d-b8dd-e065aaca39e5', '307947ca-3672-4d97-9451-117c9b24f5c9', 'e09a1a36-9f1f-4c7c-9711-0868a70c7a34'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:18 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cdde1b5-d705-48c3-90e4-5183f10de8af -F qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" returned: 0 in 0.654s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:18 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e is being set with open permissions: ugo+rw Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:18 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e Apr 29 19:23:18 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:18 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:18 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:18 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" returned: 0 in 0.621s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:18 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.605s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:18 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Deleted volume successfully. Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-9f7cf045-70bd-4da0-ab37-78415abc8936-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:18 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.info Apr 29 19:23:18 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-9f7cf045-70bd-4da0-ab37-78415abc8936-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-f8272490-5c3e-41ed-b935-66a19532507c tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-576d10f2-12ae-409c-856c-b5152a439af5-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "cinder-quobyte-9f7cf045-70bd-4da0-ab37-78415abc8936" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-9f7cf045-70bd-4da0-ab37-78415abc8936" acquired by "delete_volume" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd08db6-754f-4bae-a67d-e861a51684e5]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:18 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:19 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 Apr 29 19:23:19 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:19 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.info" returned: 0 in 0.632s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:19 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.info is being set with open permissions: ugo+rw Apr 29 19:23:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.info {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:19 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.info Apr 29 19:23:19 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:19 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936" returned: 0 in 0.728s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:19 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:19 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936 Apr 29 19:23:19 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:20 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.info" returned: 0 in 0.594s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.094s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:20 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-bed18f05-0a5f-4460-adac-56c980622478 tempest-SnapshotDependencyTests-2032207443 None] Create snapshot completed successfully Apr 29 19:23:20 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-9f7cf045-70bd-4da0-ab37-78415abc8936" returned: 0 in 0.620s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-quobyte-9f7cf045-70bd-4da0-ab37-78415abc8936" released by "delete_volume" :: held 1.384s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Created reservations ['a3d22847-e222-4607-a56d-faf70c9c6d7d', '26bfd4ab-a521-4dc2-8255-e6c1ada1a0c3', '17924f3e-4ba5-450f-a6c0-7e53b63cd22f', '2e2f09f1-1115-4e15-8612-273cc4da5ad9'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:20 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:20 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:20 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:21 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.598s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:21 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Deleted volume successfully. Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2214d8c-e326-4613-800f-eb96655bab5e tempest-VolumeDependencyTests-1145165108 None] Lock "cinder-9f7cf045-70bd-4da0-ab37-78415abc8936-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Flow 'volume_create_manager' (e905e373-a29f-47a3-9365-9b229c3b3629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7e77d6-7c29-41d0-b911-1bf136c9c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7e77d6-7c29-41d0-b911-1bf136c9c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T17:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425efb91800249829a6de3a6ffe3682d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T17:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2acb4ff0-35d1-4322-bf1e-6ebf03f8458e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T17:23:22Z,use_quota=True,user_id='38861312f1a349348eb8a5daaa36a24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8a41be8-ecd3-490b-97e7-f65a33f84742),volume_type_id=f8a41be8-ecd3-490b-97e7-f65a33f84742)' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ab093c-254f-43a9-8ad3-c34f12d6a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ab093c-254f-43a9-8ad3-c34f12d6a44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff991d8-94fb-4097-a072-ae5224fd8bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff991d8-94fb-4097-a072-ae5224fd8bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5', 'volume_name': 'volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5', 'volume_size': 1, 'snapshot_id': '2acb4ff0-35d1-4322-bf1e-6ebf03f8458e'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acf2d20-ce6b-48db-b30a-5f80b01be01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acf2d20-ce6b-48db-b30a-5f80b01be01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4991464d-ae5f-4c85-870b-335b11611a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:21 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Volume 88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5', 'volume_size': 1, 'snapshot_id': '2acb4ff0-35d1-4322-bf1e-6ebf03f8458e'} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-quobyte-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" by "_create_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Creating volume 88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 from snapshot 2acb4ff0-35d1-4322-bf1e-6ebf03f8458e {{(pid=84523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Selected osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2 as target Quobyte volume. {{(pid=84523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-quobyte-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" by "_copy_volume_from_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] snapshot: 2acb4ff0-35d1-4322-bf1e-6ebf03f8458e, volume: 88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5, {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[71066f93-c9c8-43ce-b8e5-f71ea5816583]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:21 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:22 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e Apr 29 19:23:22 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:22 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" returned: 0 in 0.805s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cdde1b5-d705-48c3-90e4-5183f10de8af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:23:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 19:23:22 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Creating direct copy from snapshot {{(pid=84523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 19:23:22 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[666da9d7-6564-4ce5-8c2c-24bd3bdb4cd3]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:22 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:22 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af Apr 29 19:23:22 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:23 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af" returned: 0 in 0.702s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:23 devstack cinder-volume[84523]: DEBUG cinder.utils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Path /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 not found in is_blk_device check {{(pid=84523) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 19:23:23 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:23 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 Apr 29 19:23:23 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:28 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" returned: 0 in 4.594s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:28 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe7ab29-b11d-4896-8f47-7821cbe09f23]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:28 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af Apr 29 19:23:28 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:28 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af" returned: 0 in 0.873s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:28 devstack cinder-volume[84523]: DEBUG cinder.image.image_utils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Image conversion details: src /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 {{(pid=84523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 19:23:28 devstack cinder-volume[84523]: INFO cinder.image.image_utils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Converted 1024.00 MB image at 222.84 MB/s Apr 29 19:23:28 devstack cinder-volume[84523]: WARNING cinder.volume.drivers.remotefs [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 is being set with open permissions: ugo+rw Apr 29 19:23:28 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:28 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 Apr 29 19:23:28 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:29 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" returned: 0 in 0.593s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" released by "_copy_volume_from_snapshot" :: held 7.671s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" released by "_create_volume_from_snapshot" :: held 7.711s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.729s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4991464d-ae5f-4c85-870b-335b11611a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5', 'volume_size': 1, 'snapshot_id': '2acb4ff0-35d1-4322-bf1e-6ebf03f8458e'}' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9ce0e1-1a13-4786-a3c0-506aee4f5c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 19:23:29 devstack cinder-volume[84523]: INFO cinder.volume.flows.manager.create_volume [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Volume volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 (88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5): created successfully Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9ce0e1-1a13-4786-a3c0-506aee4f5c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Flow 'volume_create_manager' (e905e373-a29f-47a3-9365-9b229c3b3629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 19:23:29 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-17c84979-dd47-499f-af69-6a1e09956984 tempest-SnapshotDependencyTests-2032207443 None] Created volume successfully. Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:29 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:29 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:29 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:30 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.583s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG oslo_service.periodic_task [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] Running periodic task VolumeManager._thread_info {{(pid=84523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread count: 28 {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.volume.manager [None req-c78b20cd-e8f9-4148-80ec-411e093eafe7 None None] thread info: [<_MainThread(MainThread, started 125004431114368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=84523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e-delete_snapshot" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-quobyte-5cdde1b5-d705-48c3-90e4-5183f10de8af" by "delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-5cdde1b5-d705-48c3-90e4-5183f10de8af" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-quobyte-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" by "_delete_snapshot" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Deleting offline snapshot 2acb4ff0-35d1-4322-bf1e-6ebf03f8458e of volume 5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] snapshot_file for this snap is: volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e {{(pid=84523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[889541dc-587b-4b59-98fc-e2e1c47c99ea]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:30 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:30 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e Apr 29 19:23:30 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:31 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" returned: 0 in 0.696s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:31 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.remotefs [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cdde1b5-d705-48c3-90e4-5183f10de8af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 19:23:31 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6871602-a6c3-4128-bfd8-4c1bf12895cc]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:31 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:31 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af Apr 29 19:23:31 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:32 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af" returned: 0 in 0.686s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:32 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e Apr 29 19:23:32 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:32 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" returned: 0 in 0.708s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:32 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:32 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e Apr 29 19:23:32 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:33 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af.2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" returned: 0 in 0.584s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e" released by "_delete_snapshot" :: held 2.768s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-5cdde1b5-d705-48c3-90e4-5183f10de8af" released by "delete_snapshot" :: held 2.789s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Created reservations ['511ea4c2-de4c-415d-b3fd-3ef039f27396', 'df7406a4-c3b4-41a8-88f5-81a58eed9d78', '15b05b6c-0624-45c4-91d0-1c0bfc11ebe7', 'd0ecc2e6-f5f4-4f18-8027-355f781f054a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:33 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Delete snapshot completed successfully. Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-e2b2bda6-3770-4fc9-8591-b640ea95b52a tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-2acb4ff0-35d1-4322-bf1e-6ebf03f8458e-delete_snapshot" released by "delete_snapshot" :: held 2.927s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-5cdde1b5-d705-48c3-90e4-5183f10de8af-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-5cdde1b5-d705-48c3-90e4-5183f10de8af-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-quobyte-5cdde1b5-d705-48c3-90e4-5183f10de8af" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-5cdde1b5-d705-48c3-90e4-5183f10de8af" acquired by "delete_volume" :: waited 0.013s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[982ddadf-9d58-418d-8803-ea424d88dc24]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:33 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:33 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af Apr 29 19:23:33 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:34 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af" returned: 0 in 0.682s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:34 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:34 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af Apr 29 19:23:34 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:35 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-5cdde1b5-d705-48c3-90e4-5183f10de8af" returned: 0 in 0.572s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-5cdde1b5-d705-48c3-90e4-5183f10de8af" released by "delete_volume" :: held 1.306s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Created reservations ['6d8f5fe8-414a-4e1a-9802-c00724135dee', '7fa82c75-f8b5-4eef-a086-d6ab3cde64e0', '01d1c511-d4e6-4d4a-be7c-33d4f72ad92f', '60ddc3e5-0bae-47d8-8f4a-faf96c3b5e1b'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:35 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:35 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:35 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.573s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:35 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Deleted volume successfully. Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-76464335-27ac-4333-9b63-bc7135c56773 tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-5cdde1b5-d705-48c3-90e4-5183f10de8af-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5-delete_volume" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "cinder-quobyte-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" by "delete_volume" {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 19:23:35 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" acquired by "delete_volume" :: waited 0.015s {{(pid=84523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 19:23:36 devstack cinder-volume[84523]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d26b9f-8249-41dd-9b84-5e7a324b8cc7]: (4, 'qcow2') {{(pid=85288) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 19:23:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:36 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 Apr 29 19:23:36 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:36 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" returned: 0 in 0.693s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:36 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:36 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5 Apr 29 19:23:36 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:37 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9/volume-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" returned: 0 in 0.586s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-quobyte-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5" released by "delete_volume" :: held 1.320s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG cinder.quota [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Created reservations ['5e38e143-61ad-42ff-8f36-732745ccc217', 'a7c3b11d-24f7-4610-8ae4-2a83771a6a21', 'b92889b9-2f48-4fd0-8c40-ef1cb3a6c7a4', 'f16508bb-4149-4643-a3bc-1f3d277a623a'] {{(pid=84523) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2': None} {{(pid=84523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG cinder.volume.drivers.quobyte [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7d028596-8b6b-452a-8de5-ad280a873af2'] {{(pid=84523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.lockutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 19:23:37 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9 Apr 29 19:23:37 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 19:23:37 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG oslo_concurrency.processutils [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2a20116136e9dd8a59ad08f94297fee9" returned: 0 in 0.579s {{(pid=84523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 19:23:37 devstack cinder-volume[84523]: DEBUG cinder.manager [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Notifying Schedulers of capabilities ... {{(pid=84523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Apr 29 19:23:38 devstack cinder-volume[84523]: INFO cinder.volume.manager [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Deleted volume successfully. Apr 29 19:23:38 devstack cinder-volume[84523]: DEBUG cinder.coordination [None req-3242b589-f801-4d8e-903d-cc77a8178b3e tempest-SnapshotDependencyTests-2032207443 None] Lock "cinder-88fd28b2-95b1-40a9-91b1-ee0f3cfe91b5-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=84523) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 19:23:47 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:DELETE=12,cinder:SELECT=100,cinder:INSERT=40,cinder:UPDATE=139 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 19:23:48 devstack cinder-volume[84523]: DEBUG dbcounter [-] [84523] Writing DB stats cinder:UPDATE=161,cinder:SELECT=99,cinder:INSERT=36,cinder:DELETE=11 {{(pid=84523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}